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1.0  Abstract 


The  ability  to  determine  optimal  spectral  band  sets  for  the  exploitation  of 
multispectral  and  hyperspectral  imagery  is  of  great  concern  due  to  data  transfer, 
storage,  and  computational  constraints.  This  study  compares  the  performance  of 
three  band  selection  techniques  across  a  range  of  scenarios  and  image 
exploitation  algorithms.  Thresholded  Divergence,  a  technique  based  on  Gaussian 
Maximum  Likelihood  classification,  Forward  Sequential  Band  Selection,  an 
iterative  method  based  on  target  identification  algorithms,  and  Spectral  Basis 
Functions,  a  method  independent  of  end-exploitation,  were  selected  for 
evaluation.  Each  of  these  band  selection  techniques  was  applied  to  two  M7 
multispectral  images  and  two  HYDICE  hyperspectral  images.  Each  selected 
optimal  spectral  band  set  for  each  image  was  classified  and  assessed  for 
classification  accuracy.  Comparisons  between  band  selection  techniques  were 
made  based  on  spectral  band  subset  size,  image  exploitation  algorithm,  image  and 
scene  type,  and  input  parameter  set. 
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2J.  Introductton  and  Summary 


Multispectral  imagery  has  become  much  more  important  due  to  the  increase  in  the 
number  of  spectral  bands  in  available  imagery.  Hyperspectral  sensors  such  as  NASA’s 
Advanced  Visible  and  Infrared  Imaging  Spectrometer  (AVIRJS)  have  hundreds  of 
channels  over  a  wide  spectral  range.  While  such  technological  advances  have  greatly 
enhanced  the  contributions  of  remote  sensing,  the  associated  increase  in  data  is 
accompanied  by  subsequent  time,  cost,  and  storage  considerations.  In  the  case  of 
multispectral  image  classification,  more  basic  techniques,  such  as  minimum  distance  to 
the  mean  exhibit  a  linear  relationship  between  number  of  spectral  bands  and  increase  in 
cost.  The  same  relationship  for  more  statistically  intensive,  and  typically  more  accurate, 
techniques  such  as  Gaussian  Maximum  Likelihood  (  GML )  are  quadratic  in  nature 
(Richards,  1993).  For  example,  a  210-band  Hyperspectral  Digital  Imageiy  Collection 
Experiment  (HYDICE)  image  with  320  samples  and  960  lines  requires  over  64  Mbyte  for 
image  transfer  and  storage.  The  same  file  using  only  4  of  the  available  210  spectral 
bands  would  require  only  1.2  Mbyte.  If  equivalent  exploitation  accuracy  levels  could  be 
achieved  for  that  same  image  using  only  4  spectral  bands,  the  transfer  and  storage 
requirements  would  be  reduced  by  a  factor  of  nearly  6,  while  the  cost  of  GML 
classification  would  be  reduced  by  a  factor  of  10'*.  Clearly,  it  would  be  advantageous  to 
be  able  to  collect  data  using  only  those  spectral  bands  containing  useful  information  for 
image  classification  in  order  to  minimize  cost. 

For  this  reason,  numerous  techniques  have  emerged  to  predetermine  which  spectral 
bands  produce  optimal  classification  results.  Csillag,  et  al.  (1992)  presented  a  modified 
stepwise  principal  component  analysis  for  the  determination  of  key  spectral  ranges  for 
the  identification  of  soil  salinity  status.  Mausel,  et  al.  (1990),  Schott,  et  al.  (1988),  and 
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Rosenblum  (1990)  used  assorted  Bayesian  statistical  techniques  to  predict  optimal 
spectral  band  combinations  for  use  with  Gaussian  Maximum  Likelihood  classification. 
Similar  statistical  methods  were  used  by  Kanodia,  et  al.  (1996)  and  Hardie  (1994)  to 
select  optimal  spectral  bands  for  use  with  hypothesis  testing  and  Signal-to-Clutter  target 
identification  techniques.  Thomas  (1994)  elaborated  on  these  techniques  in  his 
development  of  a  Signal-to-Clutter  ratio  score  for  selecting  spectral  bands  to  use  in 
target  identification.  Price  (1994)  demonstrated  an  interactive  method  for  selecting 
bands  using  a  set  of  basis  fimctions.  For  the  most  part,  these  studies  have  been  fairly 
limited  in  scope  in  that  each  technique  is  geared  towards  a  specific  image  type  or 
classification  algorithm. 

In  addition,  in  many  cases  the  specific  scenario  class  statistics  or  post-processing 
algorithm  are  not  known  a  priori.  The  aforementioned  algorithms,  then,  may  be  of 
limited  value  for  predetermining  optimal  spectral  band  sets.  With  this  in  mind,  this  study 
will  focus  on  the  implementation  of  Thresholded  Divergence,  Spectral  Basis  Function, 
and  Forward  Sequential  Band  Selection  optimal  spectral  band  selection  techniques  across 
multiple  scenarios  and  multiple  classification  algorithms.  Each  of  the  band-selection 
algorithms  was  developed  under  the  Environment  for  Visualizing  Information  (ENVI™) 
using  the  Interactive  Display  Language  (IDL™)  Once  the  optimal  spectral  bands  were 
selected,  the  lower-dimensional  images  were  classified  using  Gaussian  Maximum 
Likelihood  (GML),  Signal-to-Clutter  Ratio,  and  Log-Likelihood  Ratio  classification 
algorithms.  Of  the  aforementioned  classifiers,  GML  was  run  using  existing  applications 
under  ENVI™.  Both  the  Signal-to-Clutter  Ratio  and  Log-Likelihood  Ratio  classifiers 
were  developed  under  ENVI™  in  the  course  of  this  research.  Finally,  the  classification 
accuracies  of  each  band-selection  technique  was  evaluated.  GML  results  were  evaluated 
using  independent  analysis  and  stratified  random-sampling  confusion  matrices.  The 
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Signal-to-Clutter  and  Log-Likelihood  results  were  evaluated  using  receiver  operating 
characterization  (ROC)  curves.  All  of  the  evaluation  methods  were  developed  within  the 
ENVI™  environment.  This  assessment  will  determine  if  any  one  band  selection  method 
proves  more  effective  than  its  counterparts  across  the  selected  range  of  scenarios  and 
exploitation  algorithms.  Comparisons  will  be  made  between  band  selection  techniques 
based  on  image  type,  classification  method,  and  input  parameter  combination. 
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3.0  Objectives  and  Deliverables 
Statement  of  Work 

•  Construct  a  robust  data  set  incorporating  two  (2)  M7  images  and  two  (2) 
HYDICE  images. 

•  Develop  and  implement  the  necessary  band  selection  algorithms, 
classifiers,  and  accuracy  assessment  metrics  in  the  Environment  for 
Visualizing  Information  (ENVI™)  and  the  Advanced  Visualization 
System  (AVS). 

•  Construct  common  training  sets  to  be  used  by  all  band  selectors, 
classifiers,  and  accuracy  assessment  metrics. 

•  Reduce  initial  image  spectral  band  sets  using  Eigenvector  Pre-Selection, 
Thresholded  Divergence,  Forward  Sequential  Band  Selection,  and 
Spectral  Basis  Functions  for  a  range  of  input  parameter  sets. 

•  Classify  each  image  using  the  down-selected  spectral  band  sets  using 
common  training  data  and  the  Gaussian  Maximum  Likelihood,  Signal-to- 
Clutter  Ratio,  and  Log-Likelihood  Ratio  classifiers. 

•  Generate  confusion  matrices  for  the  Gaussian  Maximum  Likelihood 
classifier  outputs.  Analyze  confusion  matrices  based  on  simple  accuracy. 

•  Generate  ROC  curves  for  the  Signal-to-CIutter  Ratio  and  Log-Likelihood 
Ratio  classifier  outputs.  Analyze  ROC  curves  based  on  the  summed 
difference  between  probability  of  detection  and  probability  of  false  alarm. 

•  Generate  confusion  matrices  and  ROC  for  top  performing  spectral  band 
subsets  using  stratified  random  sampling. 

•  Comparatively  evaluate  the  band  selection  algorithms  based  on  accuracy 
assessment  results. 
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List  of  Deliverables 

•  The  following  band  selection  algorithms  developed  under  ENVI™: 

•  Thresholded  Divergence 

•  Spectral  Basis  Functions 

•  Forward  Sequential  Band  Selection 

•  The  following  classification  algorithms  developed  under  ENVI™: 

•  Signal-to-Clutter  Ratio 

•  Log-Likelihood  Test  Ratio 

•  Accuracy  assessment  metric  developed  under  ENVI™ 

•  Independent  analysis  confusion  matrix 

•  Stratified  random  sampling  confusion  matrix 

•  Independent  analysis  receiver  operating  (ROC)  curves 

•  Stratified  random  sampling  ROC  curves 

•  A  written  document  detailing  the  spectral  band  selection  techniques  and 
their  relative  value  across  a  range  of  images  and  exploitation  algorithms. 
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M. 


Background 


4.1  Optimal  Band  Selection 

Image  collection  using  an  increasing  number  of  spectral  bands  has  naturally  resulted  in 
much  greater  quantities  of  data  to  be  processed  and  analyzed.  While  computational 
abilities  have  improved  substantially  in  recent  years,  computational  time  and  accuracy 
concerns  continue  to  steer  sensor  and  algorithm  development.  Sensor  research  and 
development  would  benefit  immensely  fix)m  reduced  computational  time  and  subsequent 
cost  if  the  spectral  bands  which  would  provide  optimal  imagery  for  a  specified 
application  and  /or  scene  could  be  known  in  advance.  The  goal  thus  far  has  been  to 
select  the  subset  of  k  bands  firom  the  total  set  of  N  bands  (where  k  <  N)  such  that  the 
classification  results  do  not  suffer  degradation.  (Rosenblum,  1990) 

A  number  of  methods  have  been  investigated  with  this  end  in  mind.  One  of  the  earliest 
techniques,  known  as  Principal  Components  Analysis  (Schowengerdt,  1983),  is  based  on 
the  understanding  that  not  all  of  the  output  multispectral  image  data  necessarily  contain 
useful  information.  The  principal  components  technique  transforms  the  multispectral 
data  into  a  coordinate  space  with  orthogonal  axes  that  are  xmcorrelated  and  ordered 
according  to  decreasing  variance.  Since  only  those  transformed  bands  with  higher  levels 
of  data  variance  are  usually  useful  for  classification,  the  amount  of  data  is  reduced  to  a 
limited  number  of  transformed  bands  which  maximize  the  data.  While  this  technique  is 
well  known,  Schott  et  al  (1988)  suggests  that  its  nature  as  a  post-acquisition  tool 
prohibits  its  use  as  a  preliminaiy  band  selection  tool. 
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4.1.1  Class  Separation  Matrix 


Schott,  et  al.  (1988)  developed  a  technique  in  which  a  class  separation  matrix  is  used  to 
determine  optimal  spectral  bands.  The  metric  is: 

(I) 

y=l/=l 

where  dy  is  the  Mahalanobis  distance  of  class  j  from  class  i  and  Wg  is  the  weight  factor.  A 
geometrical  representation  of  the  Mahalanobis  distance  is  shown  in  Figure  (1);  the 
madiematics  are  discussed  more  thoroughly  in  Section  (4.2.1).  In  Figure  (1),  Mf  and  Mj 
are  the  mean  vectors  for  class  i  and  class  j,  x  is  the  pixel  column  vector,  and  dj  and  dj  are 
the  multivariate  distances  between  the  pixel  column  vector  and  the  class  means.  In 
general  w  was  set  to  1  for  distances  between  target  and  background  classes,  and  set  to  0 
for  distances  between  backgrounds.  The  k  bands  resulting  in  a  maximum  value  for  Z  are 

Figure  1:  Geometrical  Representation  of  the  Mahalanobis 
Distance 
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deemed  optimal.  This  metric  was  designed  specifically  for  use  in  conjunction  with  the 
GML  classifier. 


Mausel,  et  al.  (1990)  compares  several  techniques  for  optimal  spectral  band  selection  for 
classification  purposesh.  Divergence,  Transformed  Divergence  (TD),  Bhattachaiyya 
Distance  (B  distance),  and  Jeffiies-Matusita  Distance  (JM)  were  selected  based  on  their 
demonstrated  abilities  to  select  subsets  of  spectral  bands  from  multidimensional  data 
resulting  in  reasonable  classification  results  using  the  GML  classifier. 

Divergence  as  presented  in  Richards  (1993)  assumes  that  the  class  means  and 
covariances  are  normally  distributed.  The  measure  of  divergence  is  written: 

-E:*)] +^7>[(E/  +E:')(p,.-p.)(p,.-p^)']  ^2) 

where  S  is  the  class  covariance  matrix,  p  is  the  class  mean  vector,  and  Tr  is  the  trace  of 
the  matrix.  The  sum  of  the  divergences  for  all  possible  class  pairs  is  presented  in 
Rosenblum  (1990)  as  the  overall  divergence;  the  set  of  spectral  bands  which  maximized 
the  overall  divergence  should  represent  the  greatest  class  separability  and,  therefore,  the 
best  classification  accuracy.  A  problem  arises  with  divergence  as  a  means  of  band 
selection  because  of  its  nonlinear  relationship  to  classification  accuracy.  Richards 
(1993)  demonstrates  that  divergence  increases  as  a  quadratic  function  of  separation 
between  multispectral  classes;  a  small  increase  in  separation  between  classes  which  are 
already  distant  will  result  in  a  substantial  increase  in  divergence  which  does  not 
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necessarily  correspond  to  the  relative  change  in  classification  accuracy. 

A  modification  known  as  the  Transformed  Divergence  atones  for  this  problem.  Defined 
as; 

(3) 

the  exponential  results  in  asymptotic  behavior  as  opposed  to  the  quadratically  increasing 
behavior  demonstrated  by  divergence. 

A  second  distance  measurement  used  for  spectral  band  selection  is  known  as  the 
Bhattacharyya  Distance.  Similarly  based  on  the  multi-dimensional  distance  between  two 
classes,  the  B-distance  is  written: 

where  once  again  Z  is  the  class  covariance  matrix  and  p  is  the  class  mean  vector.  A 
manipulation  similar  to  that  used  above  with  divergence  yields  the  Jeffries-Matusita 
Distance : 

4=P(l-e-'«)]  (5) 

The  comparative  analysis  presented  in  Mausel,  et  al.  (1990)  was  based  on  classification 
accuracies  using  data  from  the  four  best  spectral  bands  selected  by  Divergence,  TD,  B- 
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distance,  and  JM.  The  analysis  revealed  that,  while  Divergence  and  B-distance  provide 
more  precise  statistical  distances  between  the  classes,  TD  and  JM  result  in  substantially 
better  spectral  band  selection  based  on  GML  classification  accuracies.  One  additional 
point  of  interest  raised  by  Richards  (1993)  is  that  TD  is  much  less  computationally 
intensive  and,  therefore,  more  cost  effective  than  the  slightly  more  accurate  JM. 


Each  of  the  four  techniques  studied  by  Mausel,  et  al  (1990),  requires  the  same  number 
of  calculations: 


calculations = 


m  Ml 

k\iN-k)\  2!(M-2)! 


(6) 


where  N  is  the  total  number  of  bands,  M  is  the  number  of  classes  in  the  image,  and  k  is 
the  number  of  spectral  bands  in  the  desired  subset. 


4.1.3  Thresholded  Divergence 

In  her  work,  Rosenblum  (1990)  expanded  upon  the  aforementioned  concepts  to  develop  a 
technique  specifically  intended  for  feature  selection.  Beginning  with  the  conditional 
probability  similar  to  that  used  in  Gaussian  Maximum  Likelihood  (GML)  classification: 

(7) 


p(M.\i)= 


(2ity^E,- 1 


1/2 


where  Z;  is  the  covariance  matrix  and  Mj  and  Mj  are  the  multivariate  class  mean  vectors, 
we  can  take  the  natural  logarithm  and  add  ln|Si|  to  both  sides  such  that: 
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distance,  and  JM.  The  analysis  revealed  that,  while  Divergence  and  B-distance  provide 
more  precise  statistical  distances  between  the  classes,  TD  and  JM  result  in  substantially 
better  spectral  band  selection  based  on  GML  classification  accuracies.  One  additional 
point  of  interest  raised  by  Richards  (1993)  is  that  TD  is  much  less  computationally 
intensive  and,  therefore,  more  cost  effective  than  the  slightly  more  accurate  JM. 


Each  of  the  four  techniques  studied  by  Mausel,  et  al  (1990),  requires  the  same  number 
of  calculations: 


calculations = 


m  M. 

k\(N-k)\  2!(M-2)! 


(6) 


where  N  is  the  total  number  of  bands,  M  is  the  number  of  classes  in  the  image,  and  k  is 
the  number  of  spectral  bands  in  the  desired  subset. 


4.13  Thresholded  Divergence 

In  her  work,  Rosenblum  (1990)  expanded  upon  the  aforementioned  concepts  to  develop  a 
technique  specifically  intended  for  feature  selection.  Beginning  with  the  conditional 
probability  similar  to  that  used  in  Gaussian  Maximum  Likelihood  (GML)  classification: 

(7) 


where  Sj  is  the  covariance  matrix  and  Mj  and  Mj  are  the  multivariate  class  mean  vectors, 
we  can  take  the  natural  logarithm  and  add  ln|Si|  to  both  sides  such  that; 
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(8) 


D.+lnE,i=-21n[ 


where 

(Mj-M)  (9) 


The  quantity  on  the  left  side  of  equation  (8)  is  the  measured  distance  between  two  class 
means  when  individual  class  covariances  are  used.  Figure  (2)  illustrates  how  the  distance 
from  /  to  j  will  not  be  the  same  as  the  distance  from  j  to  i  in  probability  space  when  the 

Figure  2:  Statistical  Distance  Between  Class  Means 


covariance  matrbc  from  class  j  is  used.  The  dimensions  of  each  ellipse  in  Figure  (2) 
depend  on  the  class  variance  from  which  the  statistical  distances  are  measured.  Based  on 
the  ellipses  shown,  the  variance  for  class  i  is  considerably  smaller  than  that  of  class  j. 
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Thus,  the  distance  measurement  between  class  i  and  class  j  based  on  the  variance  in  class 
i  is  larger  than  the  distance  measurement  based  on  the  variance  in  class  j. 


The  right  side  of  equation  (8)  defines  the  necessary  separation  distance  between  two 
class  means  for  a  probability  of  misclassification  P(Mj|i).  A  threshold  is  defined  using 
equation  (10): 

(10) 


^thresh 


'  any 


n } 


If  the  measured  distance  (D;  +  ln|Ei| )  between  two  class  means  is  greater  than  the 
distance  is  sufficient  for  reasonable  classification  accuracies.  Finally,  a  ratio  is 
computed  to  prevent  inflation  of  the  sum  of  all  distances  between  classes: 


^ratio 


*thresh 


(11) 


in  which  values  for  djjtjo  greater  than  1  are  set  equal  to  1 . 


The  ratio  of  thresholded  distances  between  all  classes  for  a  specified  subset  of  features 
form  a  matrix 


Dr  = 


^rll  ^rI2 


*r2l 


% 


^rli\ 


^rji 


(12) 


where  <1^12  is  the  ratio  of  the  distance  between  classes  1  and  2  using  the  covariance  matrix 
for  class  2.  The  sum  of  the  matrix  elements  represents  the  quality  of  class  mean 
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separation  using  the  specified  feature  subset.  That  subset  resulting  in  the  highest  summed 
distance  ratio 


h0m=0 


(13) 


should  represent  the  optimal  subset  of  features. 


This  metric  was  used  in  conjunction  with  the  GML  classifier.  The  results  of  the  study 
presented  in  Rosenblum  (1990)  demonstrated  that  the  thresholded  Mahalanobis-like 
distance  D,  produced  classification  accuracies  equivalent  to  those  obtained  via 
Transformed  Divergence,  yet  required  approximately  1/6  the  computational  time. 

4*14  jPorwurd  Sequential  Band  Selection  nffSHS) 

While  the  Bhattachaiyya  Distance  used  in  the  JM  measurement  was  presented  earlier  in 
section  (4.1.2)  as  computationally  intensive  without  substantially  greater  classification 
accuracy  as  compared  to  Thresholded  Divergence,  a  different  approach  presented  in 
Hardie  (1994)  seems  promising  for  optimal  spectral  band  selection. 

Hardie  (1994)  strongly  suggests  using  prescreening  to  initially  eliminate  extraneous 

spectral  bands.  Once  this  is  accomplished,  an  optimal  set  can  be  determined.  Used  in 

conjunction  with  target/backgroimd  multispectral  imageiy,  this  technique  as  it  is 
presented  assumes  sufficient  training  data  from  both  the  target  and  background  class. 

The  procedure  is  as  follows: 

(a)  Select  the  band  with  the  highest  B-distance  of  the  N  candidates. 

(b)  Pair  each  of  the  remaining  (N-1)  bands  with  that  selected  in  step  (a)  and  select 
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the  band  yielding  the  largest  2-D  B-distance. 

(c)  Pair  the  remaining  (N-2)  bands  with  the  pair  selected  in  step  (b);  choose  the 
band  yielding  the  largest  S-D  B-distance. 

(d)  Repeat  the  procedure  until  the  desired  number  of  bands,  J,  have  been  selected. 
The  B-distance  is  written: 


1  /E.+E.V'  1 


(14) 


where  p  is  the  class  mean  and  Z  is  the  class  covariance  matrix.  Where  training  data  are 
required,  the  class  mean  vectors  and  covariance  matrices  can  be  approximated  by  the 
training  sample  class  mean  and  covariance.  This  process  is  referred  to  throughout  the 
course  of  this  study  as  Forward  Sequential  Band  Selection  (FSBS).  Using  the  above 
procedure,  the  number  of  B-distance  computations  is: 


calculations  =J(N- — + — ) 
2  2 


(15) 


Hardie  was  able  to  show  using  this  method  that  the  set  of  optimal  spectral  bands  for 
target  identification  varied  according  to  class. 


f*tlt5  Spectral  Basis  Functions 

A  technique  introduced  by  Price  (1994)  expands  the  image  over  a  set  of  basis  functions 
to  determine  the  location  and  width  of  the  spectral  intervals  which  optimize  the  system. 
The  idea  of  using  basis  functions  to  approximate  a  distribution  is  not  new.  The  well- 
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known  Fourier  series  is  perhaps  the  best  known  set  of  basis  functions.  The  Fourier 
representation  may  be  used  to  approximate  the  square  wave  function  as  a  sum  of  sines 
and  cosines.  The  square  wave  function  is  defined: 


,  1,  2«7C<x<(2«-1)k 
y(x)=l  0,x=n7r 

-1,  Q,n-V)'K<x<lnn 


(16) 


The  Fourier  Series  can  be  written: 

a„cosra:+52  i>„sinnx 


(17) 


where  Ug,  a„  and  b„  are  coefficients  and  the  periodic  functions  cos(nx)  and  sin(nx)  are 
basis  fimctions.  Definite  integrals  relate  the  coefficients  to  the  periodic  functions  as 
follows: 

TtJO  '  ' 


K‘-r'Ai)sHnt)dl 

tzJq 


(19) 


Figures  (3)  and  (4)  illustrate  how  individual  sine  curves  may  be  summed  to  approximate 
the  square  wave  function  defined  in  Equation  (16). 
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Figure  3;  Individual  Sine  Curves 


Figure  4:  Summed  Sine  Curves  -  Step 
Function  Approximation 


In  a  similar  manner.  Price  (1994)  approximates  spectra  as  the  expansion  over  a  set  of 
basis  functions 


M 


/=! 


(20) 


where  the  N-dimensional  vector  jc  represents  a  measured  spectrum,  the  coefficients  5, 
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are  wavelength  integrals,  and  (p(X)  are  the  basis  function  spectral  shapes. 

4,1.5.a  Development 

Price  (1992)  bases  the  development  of  this  approximation  on  a  tiiree-step  iterative 
process.  In  the  first  step,  he  uses  Gram-Schmidt  orthonormalization  to  select  a 
preliminary  set  of  M-dimensional  basis  vectors.  We  can  begin  by  defining  x  to  be  a 
spectral  measurement  of  dimensionality  N, 

x“=(XiPC2v->:„)  (21) 


and  {Sx)  to  be  a  set  of  residual  measurement  vectors  of  level  K.  For  K=0,  (<$c)  represents 
the  difference  from  the  mean  of  the  data  set  (Sc=  x-<jc>)  while  for  values  of  K  >  0,  (&:) 
can  be  written  <5c=  x  -  (fit  to  level  K).  Based  on  these  definitions,  we  can  construct  a 
basis  iteration  K+1  by  selecting  vectors  Sx  for  which  |(5ic|  >£• .  Selection  of  f  will  be 
described  shortly.  The  process  begins  by  averaging  the  first  M  spectra  which  obey  the 
condition  |<5c|>£'to  construct  a  unit  vector 


(22) 


Subsequent  vectors  are  reduced  in  this  process  by  subtracting  the  previously  obtained 
projections.  For  example,  after  Ci  is  obtained,  each  vector  is  reduced  to 

6x'=6x-(ei&x)ej  (23) 
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Subsequent  unit  vectors  Cj  are  based  on  the  previously  obtained  vectors  e^j.  An  initial 
value  for  f  is  determined  by  trial  and  error  such  that  M  vectors  are  selected.  This  value  is 
then  reduced  accordingly  in  subsequent  iterations.  After  several  iterations,  we  can 
represent  each  spectrum  by 

(24) 


where  c,=(e,  •^)  and  r  is  the  residual. 

In  step  two.  Price  (1992)  derives  the  principal  components  of  the  covariance  matrix  |c,Cy| 
to  calculate  the  M-dimensional  eigenvectors  C,  that  exhibit  most  of  the  total  variability  in 
the  original  spectrum.  These  M  eigenvectors  may  be  used  to  approximate  the  N- 
dimensional  eigenvectors 

Cfj  (25) 


of  the  N-dimensional  original  data.  We  can  express  Sc  at  level  K  as 

(26) 

where  Ci=(E,  -Sc).  It  is  important  to  note  that  the  original  e„  as  well  as  the  vectors  E„  are 
subject  to  noise  in  the  measured  spectra. 

The  third  step  is  based  on  the  understanding  that  most  of  the  variability  in  the  spectra  is 
described  by  the  first  few  eigenvectors,  E,  that  these  eigenvectors  vaiy  continuously  and 
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relatively  slowly  with  respect  to  wavelength,  and  that  each  eigenvector  represents  the 
spectral  behavior  across  the  full  spectrum.  With  this  in  mind,  a  single  parameter  can  be 
written 


S  “  =  fdx  ^dX.  = - - - f  VA 

J  (X,.(max)  -  A  .(min)]  J  x,<mm) 


(27) 


where  the  integral  across  the  broad-band  interval  from  the  spectral  region  where  the  first 
eigenvector  is  large  describes  the  total  spectral  behavior  of  the  eigenvector.  It  is 
important  to  note  that  die  integral  value  is  simply  an  approximation  due  to  the  exclusion 
of  the  smaller  eigenvector  contributions  to  the  broad-band  integral.  The  obtained 
integral  value  can  then  be  used  to  construct  a  wavelength-dependent  fitting  function 

(28) 


where  cp  is  determined  by  the  best  fit  across  the  data  set 

<6jc“5;*> 

<p/A)= -  (29) 

<(5“)2> 


The  definition  of  the  normalization  for  cp  is 

f<f>Ar  -A.(min)] Lfinin)  (3®) 


and  the  value  6x  at  each  iteration  level  K  is  approximated  by 
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(31) 


6xg‘‘(p^{X)S^=<p^(X)f6x 


Level  K  is  reached  when  the  residual  vectors  are  dominated  by  noise  or  no  longer  display 
an  observable  pattern.  Convergence  depends  on  accurate  selection  of  the  spectral 
interval  corresponding  to  the  first  eigenvector,  Ej.  Finally,  since  the  mean  of  the  data  set 
is  well  described  by  cp,  it  follows  that 

■  (32) 


which  is  the  approximation  to  the  measured  spectrum  x  at  level  K. 

4.L5,b  Application 
Initial  Interval  Selection 

Assuming  no  a  priori  knowledge  of  the  data  set  under  consideration.  Price  (1994) 
initiates  interval  selection  for  the  given  multispectral  spectrum  x  by  averaging  the 
spectrum  over  a  fixed  number  of  spectral  data  points,  where  x  represents  the  averaged 
spectra: 

_  z 


j 


2Z 


(34) 
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Using  these  averaged  values,  the  cosignal  matrix,  Cg,  is  calculated: 


(35) 


where  the  trace  of  the  cosignal  matrix  represents  an  estimate  of  the  total  variance  in  the 
data.  A  trial  spectral  interval  ^  is  selected.  The  remaining  spectral  measurements, 
are  then  transformed  due  to  a  reduction  by  their  correlation  with  the  value  for  the  interval 
h  such  that: 


x/=x.- 


(36) 


where 


_  ^f) 

(0.0^)  (^"^ 


and 


of=(Ex,:') 


(38) 
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It  then  becomes  clear  that  the  revised  cosignal  matrix  can  be  written: 


(39) 


where  the  corresponding  residual  trace  is  determined  to  be: 

TriCy)-Tric!)=E^^^a^r^^  (40) 


Price  (1994)  uses  this  calculation  to  determine  an  initial  estimate  of  spectral  intervals  in 
which  residual  is  determined  for  each  possible  value  of  h.  The  value  of  h  resulting  in  the 
smallest  residual  value  is  selected,  and  the  entire  process  is  repeated  beginning  with  the 
new  cosignal  matrix  Cjj*  for  selection  of  the  remaining  spectral  intervals.  Reduction  of 
the  residual  by  99.9%  is  considered  a  reasonable  result.  Using  the  determined  spectral 
intervals  in  the  spectral  basis  function  equations  provides  an  initial  approximation  to  the 
set  of  optimal  spectral  intervals. 

Basis  Function  Calculation 

The  set  of  basis  functions  is  calculated  using  the  determined  initial  spectral  intervals  and 
the  following  sequence  (Price,  1994).  From  theory,  we  know  that  each  S,  is  the  integral 
over  the  selected  interval  [A.j(min),  l®ss  the  previously  determined  fitting  series: 

(41) 
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We  can  define: 


s.= ^xdX. 


(42) 


and 


(43) 


so  that  Si=Sj  and  for  />! 


(44) 

j=\ 

which  can  also  be  written: 

i 

(45) 

j=\ 

where  d,,=  1.  By  substitution  and  changing  the  order  of  summation,  then,  we  obtain: 


j-i  f-i 


5:  b.dus, 


(46) 


A  comparison  of  eq(45)  and  eq  (46)  reveals  that: 
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(47) 


z-l 


kv 


Substituting  the  above  expressions  into  the  equation  for  the  basis  function  (p, ,  we  see  that 


{(x 

j=\  *=1 


(48) 


If  the  quantity  P  is  defined  such  that 

P.j=  E 

A=l/=1 

then  the  basis  function  can  be  written  more  simply: 

i'EdijbcSj)  - 

,n  =iil _ tl _ 


The  sequence  of  basis  function  calculations  is  as  follows: 

(a)  Compute  <xSi>  and  <SiSj>  for  i  and  j  from  1  to  M; 

(b)  Compute  the  first  basis  function  (p,=<xsj>/<s,^>; 
For  i>  1, 

(c)  Compute  by  with  equation  (43); 

(d)  Compute  dy  with  equation  (47);  and 


(49) 


(50) 
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(e)  Calculate  (p;  in  terms  of  bjj,  dy,  <SiSj>  and  the  lower-order  basis  functions  (pj 
using  equations  (49)  and  (50). 

Interval  Refinement 

Additional  refinement  of  the  preliminary  basis  functions  is  required,  however,  to  produce 
an  optimal  set.  Price  (1994)  suggests  the  following  procedure: 

(a)  Broaden  or  narrow  the  preliminary  spectral  interval  so  that  a  central  element 
of  the  spectral  basis  function,  (p,  exceeds  a  value  of  0.85  -  0.90  .  While 
broadening  the  interval  increases  the  signal-to-noise  ratio,  narrowing  the  interval 
eliminates  regions  with  poor  correlation  to  the  main  signal. 

(b)  In  the  case  of  overlap  such  that  both  basis  functions  are  above  0.85-0.90,  a 
wavelength  should  be  selected  which  separates  the  two  intervals  at  the  value  at 
which  the  preliminary  basis  functions  are  equal. 

(c)  Using  the  finalized  spectral  intervals,  calculate  the  set  of  optimal  basis 
functions  using  equations  (41)-(50). 

Price  used  this  technique  in  conjunction  with  reflectance  data  sets  of  special  interest  to 
agriculture  covering  the  range  0.40  -  2.50  pm.  It  was  found  that,  for  the  data  considered, 
15-25  spectral  intervals  were  sufficiently  representative  of  the  range  of  spectral 
variability.  However,  the  presence  of  minerals  and  artificial  materials  required  more 
spectral  intervals  for  adequate  representation. 
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4.1.6  Summary 


The  three-band  selection  algorithms  chosen  for  further  analysis  are  Thresholded 
Divergence  (TD),  Spectral  Basis  Fimctions  (SBF)  and  Forward  Sequential  Band 
Selection  (FSBS).  Thresholded  Divergence  was  selected  for  its  demonstrated 
effectiveness  when  used  in  conjunction  with  GML  classification.  The  FSBS  technique 
uses  Bayesian  statistics  similar  to  those  used  in  TD,  but  specifically  for  the  task  of  target 
identification  rather  tiian  land  cover  classification.  Finally,  SBF  was  selected  for  its 
mathematical  robustness  and  lack  of  specific  classification  algorithm  for  which  it  was 
intended.  Each  of  file  three  band-selection  techniques  will  be  applied  to  the  known  or 
predicted  class  statistics  of  the  sample  images  to  select  the  A:  best  bands.  The  selected 
optimal  band  sets  selected  by  the  three  techniques  will  be  compared.  The  images  will 
then  be  classified  using  Gaussian  Maximum  Likelihood  for  landcover  classification,  and 
Signal-to-Clutter  Ratio  and  Log-Likelihood  Test  Ratio  for  target  identification.  The 
landcover  classification  results  will  be  entered  into  confusion  matrices  based  on  both 
independent  sampling  and  stratified  random  sampling  for  analysis  and  comparison. 
Similarly,  fiie  target-identification  results  will  be  entered  into  ROC  curves  based  on  both 
independent  sampling  and  stratified  random  sampling  for  analysis  and  comparison.  In 
this  way,direct  comparisons  can  be  made  of  the  results  of  each  band  selector  for  a  single 
image  and  across  the  range  of  images  with  respect  to  both  landcover  classification  and 
target  identification. 
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4t2.  Classification  Techniques 


Numerous  techniques  exist  for  the  classification  of  multispectral  images.  Differences 
between  the  various  methodologies  arise  in  the  implied  assumptions,  statistical  rigor,  and 
desired  ouqjut.  As  this  study  will  concentrate  on  two  of  the  more  predominant 
classification  types,  landcover  and  target/background,  the  methods  selected  for 
discussion  are  accepted  and  established  classification  techniques. 

£2d.  Gaussian  Maximum  Likelihood 


Frequently,  a  multispectral  image  is  segmented  into  various  distinct  classes  according  to 
material  or  landcover  type.  While  a  number  of  techniques  perform  this  type  of 
classification,  this  study  will  focus  on  Gaussian  Maximum  Likelihood  classification 
under  Bayesian  assumptions.  Previous  studies  (Nessmiller,  1995)  have  shown  GML  to  be 
a  solid  approach  with  classification  accuracies  better  than  those  acquired  using  Fuz2y  K- 
Means  techniques  and  approaching  tfiose  of  ARTMAP.  A  detailed  presentation  of  GML 
classification  is  found  in  Schott  (1997). 

We  define  a  column  vector  (X)  comprised  of  digital  count  values  (DC)  in  each  of  J 
spectral  bands  for  each  pixel,  where 

X^=[Dq,DC2,...,DCj]  (51) 

The  multivariate  mean  for  class  /  can  be  written 

. (52) 
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where  the  K  classes  are  represented  by  /  =  1, 


Bayesian  probability  theory  defines  the  a  posteriori  probability  that  a  pixel  with  spectral 
vector  X  belongs  in  class  i  as  p(/|X): 


pm= 


p(X\i)p{i) 

PiX) 


(53) 


where  the  a  priori  probability,  p(/),  is  the  probability  of  a  randomly  sampled  pixel  being 
in  a  given  class;  the  conditional  probability,  p(X|/),  describes  the  probability  of  a  vector 
occurring  subject  to  the  condition  that  we  are  sampling  from  the  rth  class;  and  p(X)  is  the 
probability  of  the  digital  count  occurring  anywhere  in  the  image. 


When  the  class  histograms  can  be  assumed  to  be  approximately  Gaussian,  the  mean 
vector  and  covariance  matrix  of  the  training  data  can  be  used  to  estimate  the  conditional 
probability  according  to ; 


p(Xio= 


(54) 


where  Sj  is  the  covariance  matrix  for  class  /: 


®»72  — 

^ilj 

^i2I  ••• 

.0..,  ...  . 

(55) 
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(56) 


The  covariance  ojk  between  spectral  bands  j  and  k  for  class  i  is  written: 

_  (dc/9)-dc,„P(dc„(?)-zx:,^) 

O  • ~  . 


for  N  pixels  in  the  sample  set. 


Substituting  back  into  equation  (53)  yields  the  a  posteriori  probability  for  X  if  the  data 
are  normally  distributed. 


pm- 


p(0 


%  * 


p/2|c  |l/2 


p(A)(2iiy'^|5,| 


(57) 


However,  since  p(X)  is  the  same  for  all  classes  and  thus  will  not  alter  the  rank  ordering 
of  the  a  posteriori  probabilities,  it  can  be  eliminated  from  the  classifier  to  obtain  a 
simpler  expression: 

D'i=p(X[i)P{i)  (58) 


Additional  simplification  is  achieved  by  redefining  D  via  a  logarithm: 

D,=ln[p(01-ita(2l)-ilii|Shi(X-A//S,‘‘(-^-J^,)  (59) 

Values  of  the  mean  vector  Mj  and  the  covariance  matrix  Sj  can  be  estimated  from 
training  data,  and  the  a  priori  probability  p(/)  can  be  estimated.  The  pixel  corresponding 
to  the  spectral  vector  X  is  assigned  to  the  class  yielding  the  highest  value  for  Dj.  Where 
the  class  probabilities  can  be  assumed  equal  and  the  sign  of  the  function  is  reversed,  the 
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discriminant  can  be  written: 


(60) 


Finally,  in  the  case  where  both  the  class  probabilities  p(i)  and  the  class  covariances  S;  are 
equal,  the  first  three  terms  of  Dj  no  longer  contribute  to  the  discriminating  ability  of  the 
metric.  The  discriminant  then  reduces  to 

D.={X-MfS-\X-M;)  ■  (61) 


which  is  commonly  referred  to  as  the  square  of  the  Mahalanobis  distance.  Figure  (5) 
provides  a  visualization  of  GML  classification  of  a  two-band  image  with  three  classes. 

Figure  5:  GML  Classification  of  a  Two-Band  Image 
(Allen,  1997) 
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Each  ellipsoid  is  representative  of  the  GML  discriminant  value  and  centered  about  its 
multivariate  mean  M.  In  this  case,  the  pixel  vector  jc  would  be  classified  as  a  member  of 
class  1.  Diagonal  ellipsoids  are  the  result  of  correlation  between  class  digital  counts  in 
the  two  spectral  bands. 

When  using  the  GML  classifier,  it  is  crucial  that  the  training  data  set  be  sufficiently 
robust,  the  data  approximate  a  Gaussian  distribution,  and  that  all  classes  are  included  in 
the  training  data. 

4.2.2  Signal  to  Clutter  Ratio 

A  second  desirable  use  for  multispectral  imagery  is  the  detection  of  small  targets  in 
highly  structured  backgroimds.  In  signal  detection,  noise  is  loosely  defined  to  be  any 
process  that  can  obscure  or  eliminate  the  pattern  to  be  detected,  and  the  signal-to-noise 
ratio  (SNR)  is  used  to  evaluate  the  effect  of  system  noise  on  the  output.  In  multispectral 
imagery  used  for  target  detection,  the  background  pixels  act  as  noise.  However,  since 
this  noise  is  not  internal  to  the  system,  it  is  commonly  referred  to  as  clutter,  and  the 
signal-to-clutter  ratio  (SCR)  is  used  as  a  measure  of  target  detectability.  (Thomas,  1994) 

Mathematically,  the  multidimensional  SCR  can  be  expressed  in  terms  of  the  spectral 
signature  of  the  target,  b,  and  the  covariance  matrix  of  the  background  clutter,  M 
(Kanodia  et  al,  1996;  Stocker  eta/.,  1990): 

SCR=[b  (62) 

It  is  interesting  to  note  that  the  SCR  is  similar  to  the  square  root  of  the  aforementioned 
Mahalanobis  distance,  although  the  target  class  mean  vector  is  not  subtracted  from  the 
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spectral  signature  of  tiie  target  Hardie  (1994)  additionally  points  out  that  the  SCR 
measure  is  essentially  the  first  term  of  the  Bhattacharyya  distance  represented  in 
Equation  (14)  in  the  case  where  fij  =  0,  although  the  SCR  does  not  accoxmt  for  class 
separability  based  on  covariance  differences. 

In  the  course  of  classification,  the  SCR  acts  as  a  hypothesis  test.  As  described  by 
Thomas  (1994),  the  vector  b  represents  an  image  pixel  such  that  the  relative  position  of  b 
with  respect  to  the  clutter  center  is  used  to  assign  the  pbcel  to  the  target  or  background 
class.  The  elliptical  decision  boundary  for  this  two  band  space  is  determined  using  the 
sample  mean  and  covariance  estimates.  A  graphical  representation  of  SCR 
classification  is  shown  in  Figure  (6).  In  this  hypothetical  case,  b  would  more  likely  be 
assigned  to  the  target  class. 

Figure  6:  SCR  Graphical  Representation  (Thomas,  1994) 


DC  Count 
Band  2 
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4JL3  Log-Likelihood  Test  Ratio 


A  second  commonly  used  classification  technique  for  target  detection  is  the  Log- 
Likelihood  Ratio  test  described  in  Yu,  et  a/.(1993),  Stocker,  et  a/.(1990),  and  Hardie 
(1994).  An  optimum  detector  is  defined  as  that  which  maximizes  the  probability  of 
detecting  a  signal  pattern,  or  similarly,  that  which  minimizes  the  probability  of 
classification  error.  Assuming  two  classes  (target  and  background),  hypotheses  can  be 
defined  in  which  the  symbol  indicates  that  the  spectral  vector  x  belongs  to  the 
background  class  while  the  symbol  >**'  indicates  that  x  belongs  to  the  target  class. 
Bayesian  statistics  define  a  likelihood  ratio  in  which : 


(63) 


where  p(x|Hb)  and  p(x|  Hj)  are  the  conditional  probability  density  functions  for  the 
observed  spectral  vector  x.  and  P,  are  the  a  priori  probabilities.  Using  the  likelihood 


Figure  7:  Elliptical  Acceptance  Region 
(Rencher,1995) 
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function,  if  /(x)  >  Pb/Pt  the  pixel  is  classified  as  target;  if  not,  it  is  classified  as 
background.  A  graphical  representation  of  this  classification  process  is  provided  in 
Figure  (7), 


It  can  be  useful  (Hardie,  1994)  to  apply  the  logarithm  to  the  likelihood  function  to  obtain; 


-ta(/W)  =  +  ln(p(x|«,))  <"'  InA 


(64) 


In  the  case  where  both  the  target  and  background  classes  are  assumed  to  be  Gaussian 
distributions,  the  decision  rule  can  be  written  as  a  quadratic  function  in  x: 

Kx)  =  -  |(a:-P,)E;*(a:-P,)  In^  -  (65) 

where  p  represents  the  class  mean  and  I  is  the  class  covariance  matrix. 

In  the  special  case  where  the  class  covariances  are  equal,  the  decision  rule  reduces  to  a 
linear  function  in  x;  if  Pb  =  0  the  decision  rule  essentially  reduces  to  the  Signal-to-Clutter 
Ratio.  Unlike  SCR,  the  Log-Likelihood  Ratio  test  considers  class  covariances  in  tiie 
classification  process. 
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4.3  Classification  Accuracy 


Clearly,  the  optimal  means  for  assessing  classification  accuracy  would  be  to  compare  the 
classified  image  with  ground-truth  data  for  each  point  in  the  image.  Such  an  intensive 
comparison  would  be  impractical  and  unreasonable;  if  the  entire  ground  truth  were 
known  there  would  be  no  reason  to  perform  the  classification.  Instead,  sampling 
methods  are  used  to  assess  accuracy. 

4.3.1  Sample  Selection 

Richards  (1993),  Schott  (1997),  and  Rosenblum  (1990)  discuss  the  importance  of 
sample  selection  for  successful  evaluation.  Dependent/independent  analysis  is 
considered  a  simple,  yet  less  accurate  approach.  Since  the  initial  training  of  the  classifier 
involves  selection  of  class-representative  pixels,  it  is  possible  to  use  only  a  percentage  of 
the  selected  pixels  to  develop  class  statistics;  the  remainder  may  be  used  to  assess 
accuracy.  Those  pixels  used  by  the  classifier  are  considered  dependent  while  the 
remainder  are  considered  independent  as  they  do  not  influence  classification. 

Weaknesses  affiliated  with  this  method  include  a  lack  of  robustness  due  to  the  limited 
nature  of  the  sample  set. 

A  second  option  calls  for  random  sampling  of  individual  pixels  from  across  the  image  for 
comparison  with  reference  data.  In  this  way,  inaccuracies  due  to  correlation  are 
eliminated.  A  potential  problem  in  a  purely  random  approach  exists  in  the  correlation 
between  the  number  of  pixels  sampled  from  a  given  class  and  the  relative  size  of  that 
class  in  the  image;  a  large  class  will  have  a  larger  sample  size  than  a  smaller  class.  An 
approach  suggested  by  Richards  (1993)  calls  for  stratified  random  sampling  in  which  the 
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image  is  divided  into  user-defined  strata  based  on  thematic  class.  Each  stratum  then  is 
randomly  sampled  to  determine  classification  accuracy.  This  mediod,  used  in 
Rosenblum  (1990),  yielded  lower,  more  conservative  classification  accuracies  which 
were  estimated  to  more  closely  resemble  actual  results  on  the  whole  image. 

4.3.2  Confusion  Matrices 

The  results  of  such  accuracy  assessment  can  be  expressed  in  a  tabular  form  referred  to  as 
a  confusion  matrix  and  discussed  in  Schott  (1997)  and  Richards  (1993),  A  sample 
confusion  matrix  is  shown  in  Table  (1)  where  the  percentages  represent  the  proportion 
of  pixels  correctly  and  incorrectly  labeled  by  the  classifier.  In  many  cases  the 
percentages  of  correct  classifications  are  averaged  to  provide  an  overall  classification 


Table  1:  Sample  Confusion  Matrix 


II  Sample  Confusion  Matrix 

%  classified  as  class 

Class 

1 

2 

3 

4 

5 

Actual 

Class 

1 

93.5 

0.0 

2.2 

0.0 

mull 

2 

0.0 

29.7 

65.7 

0.8 

3.8 

3 

12.3 

0.0 

87.4 

0.3 

0.0 

4 

0.0 

0.0 

1.4 

98.6 

0.0 

5 

0.0 

0.0 

0.0 

0.0 

100 

%  Accuracy 

81.8 
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accuracy.  This  method  of  accuracy  assessment  will  be  used  in  conjunction  with  the 
GML  classification  results. 

4.3J  Receiver  Operating  Characteristic  Cunres 

In  the  case  of  signal  detection,  isosensitivity  curves,  also  known  as  receiver  operating 
characteristic  (ROC)  curves,  are  commonly  used  to  assess  accuracy  (Snodgrass,  1975). 
When  a  signal  is  present  in  background  clutter,  the  algorithm  or  individual  tasked  with 
signal  detection  can  produce  any  of  four  possible  results.  A  true  positive(  “hit”)  is 
defined  as  the  correct  identification  of  the  signal;  a  false  positive  “false  alarm”) 
corresponds  to  any  pixel  incorrectly  identified  as  signal  when  it  really  belongs  to  clutter; 
a  false  negative  (“miss”)  describes  any  signal  pixel  not  identified  as  signal;  and  finally  a 
true  negative  (“correct  rejection”)  corresponds  to  any  pixel  correctly  identified  as  clutter. 
When  a  sample  set  is  tested  with  respect  to  this  criteria,  probabilities  for  each  of  the  four 
categories  can  be  calculated.  These  probabilities  are  frequently  illustrated  in  matrbc  or 
plot  format.  In  matrix  form,  the  probabilities  are  displayed  as  illustrated  in  Table  (2) 
where  S  and  N  refer  to  signal  and  clutter,  respectively.  Using  this  notation,  Pr(S/N) 
signifies  the  probability  of  categorizing  a  pixel  as  signal  given  that  it  belongs  to  the 
clutter  class. 


Table  2:  Stimuli/Response  Metric 


Response 

Stimuli 

Hit:  Pr(S/S) 

Miss:  Pr(N/S) 

False  Alarm: 
Pr(S/N) 

Correct 

Rejection: 

Pr(N/N) 
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These  probabilities  can  also  be  presented  as  isoprobability,  or  receiver  operating 
characteristic  (ROC),  curves  in  which  the  probability  of  a  hit  is  plotted  against  the 
probability  of  a  false  alarm.  A  sample  ROC  curve  is  shown  in  Figure  (8).  This  technique 
will  be  used  in  conjunction  with  the  Signal-to-Clutter  Ratio  and  Log-Likelihood  Ratio 
classification  results. 


Figure  8:  Sample  ROC  Curve 
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SA  AfPROAPa 


While  it  is  unlikely  that  a  single  algorithm,  or  even  a  series  of  algorithms,  can  provide 
results  comparable  to  those  obtained  with  the  case-specific  techniques,  it  is  conceivable 
that  such  a  process  might  provide  sub-optimal,  yet  reasonable,  results  across  the  range  of 
scenarios  and  exploitation  algorithms.  With  this  in  mind,  this  study  will  focus  on  the 
implementation  of  Thresholded  Divergence,  Spectral  Basis  Functions,  and  Forward 
Sequential  optimal  spectral  band  selection  techniques  across  multiple  scenarios  and 
multiple  classification  algorithms.  The  effectiveness  of  each  of  these  band  selection 
techniques  will  be  evaluated  with  respect  to  classification  accuracy  metrics  to  determine 
if  any  one  band  selection  algorithm  proves  effective  across  the  range  of  scenarios, 
classification  algorithms,  and  input  parameter  sets. 

M  Image  Data 

Images  selected  for  this  series  of  tests  encompass  the  necessaiy  characteristics  for  both 
landcover  classification  and  target  identification.  Landcover  classification  requires  a 
wide  sampling  of  terrain  and  content,  whereas  target  identification  requires  that  a  clear 
target  be  distinguished  from  backgroxmd  clutter.  In  this  particular  study,  images 
containing  landcover  classes  and  target/background  pairs  with  similar  spectral 
characteristic  were  particularly  desirable  for  stressing  the  band  selection  algorithms. 

Two  M7  images  and  two  Hydice  images  represented  a  sufficiently  robust  data  set 
incorporating  all  of  the  required  characteristics. 
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S.1.1  Tank  Scene 


The  image  referred  to  throughout  this  study  as  the  tank  scene  (  Figure  9)  was  captured  as 
part  of  the  Southern  Rainbow  collection  by  the  Environmental  Research  Institute  of 
Michigan  (ERIM)  using  a  16-band  M7  aerial  line  scanner.  The  bandpasses  used  in  this 
study  are  listed  in  Table  (3);  the  thermal  band  (16)  was  not  used  in  die  study.  This  scene 
presented  a  range  of  natural  and  man-made  land  cover  classes  including  parking  lots, 
building  roofs,  roads,  forest,  and  scrub.  The  generic  scrub  class  was  sub-divided  into 
multiple  classes  in  order  to  stress  the  band  selection  algorithms.  Man-made  building 
roofs  served  as  targets  for  the  target  identification  algorithms. 


Figure  9:  Tank  Scene 


Table  3:  Southern  Rainbow  Bandpass 


M7Band 

Bandpass  (pm) 

1 

0.45-0.47 

2 

0.48-0.50 

3 

0.51-0.55 

4 

0.55-0.60 

5 

0.60-0.64 

6 

0.63-0.68 

7 

0.68-0.75 

8 

0.71-0.81 

9 

0.81-0.92 

10 

1.02-1.11 

11 

1.21-1.30 

12 

1.53-1.64 

13 

1.54-1.75 

14 

2.08-2.20 

15 

2.08-2.37 
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The  scene  referred  to  as  the  desert  scene  was  collected  using  the  Daedalus  airborne 
sensor  as  part  of  the  Western  Rainbow  Joint  Camouflage  Concealment  and  Deception 
(JCCD)  collection.  While  tiiis  scene  provided  less  variety  than  the  tank  scene,  it 
included  man-made  vehicles  (tanks)  for  target  identification  and  multiple  sand  types  widi 

similar  spectral  characteristics  to  stress  the  band  selection 

Figure  10:  Desert 

gggjjg  algorithms.  A  tent  served  as  the  target  for  target  identification 

algorithms.  As  with  the  tank  scene,  the  thermal  bands  were  not 
used.  The  remaining  10  bandpasses  are  listed  in  Table  4. 


5.1.3  Panel  Scene 


Figure  12:  Panel 
Scene 


The  scene  referred  to  throughout  this  study  as  the  panel  scene 
is  a  portion  of  the  ARM-HYDICE  scene,  Run  07,  collected  by 
the  Hyperspectral  Digital  Imagery  Collection  Experiment 
sensor  (HYDICE).  The  sensor  is  an  imaging 
spectroradiometer  with  a  ciyogenically  cooled  InSb  focal 
plane  array.  The  bandpass  of  0.40  to  2.5  microns  is 
contiguously  sampled  with  spectral  chaimels  of  width  10  nm. 
This  particular  subset  of  the  ARM-HYDICE  site  offers  a  range 
of  natural  and  man-made  landcover  classes  including  various 
pasture  types,  water,  wheat,  buildings,  roads  and  a  series  of 
man-made  reflectance  panels.  One  reflectance  panel  was  used 
as  tire  target  for  target/background  classification. 


Figure  13:  Pasture 
Scene 

5.1.4  Pasture  Scene 

The  pasture  scene  is  also  a  portion  of  the  ARM-HYDICE 
scene.  Run  07,  collected  by  the  Hyperspectral  Digital 
Imagery  Collection  Experiment  sensor  (HYDICE).  While 
this  scene  had  fewer  landcover  classes  than  the  panel  scene, 
it  included  pasture,  water,  unknown,  and  various  types  of 
wheat.  A  small  pond  served  as  the  target.  Wheat  fields  were 
sub-divided  to  stress  the  band  selection  algorithms. 
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5.2  Training  Data  Sets 

Class  training  sets  are  collections  of  the 
digital  counts  in  each  spectral  band  for  user- 
selected  pixels.  Landcover  class  training 
sets  as  well  as  target  and  background 
training  sets  were  acquired  from  the  test 
images  using  Environment  for  Visualizing 
Information  (ENVI™).  The  data  sets  were 
applied  to  Eigenvector  Pre-Selection, 

Thresholded  Divergence,  Forward  Sequential  Band  Selection,  Gaussian  Maximum 
Likelihood,  Signal-to-Clutter  Ratio,  and  Log-Likelihood  Test  Ratio.  The  ROI  selection 
tool  was  used  to  superimpose  colored  polygons  over  the  image  in  order  to  designate  the 
desired  classes.  A  different  color  polygon  was  used  for  each  class  as  shown  in  Figure 
(14).  Sk  training  class  sets  were  built  for  each  image;  two  simple  landcover  class  sets, 
two  sub-divided  landcover  class  sets,  and  two  target/background  sets.  Within  each  of  the 
three  types  of  ROI  sets,  one  set  was  used  in  the  band  selection  and  classification 
algorithms,  while  the  other  was  used  for  construction  of  the  independent  analysis 
confusion  and  stimuli/response  matrices.  The  simple  landcover  class  set  differs  from  the 
sub-divided  landcover  class  set  in  that  some  generic  landcover  classes  were  subdivided 
into  separate  classes  with  similar  spectral  characteristics  in  an  attempt  to  stress  the  band 
selection  algorithms. 


Figure  14:  Sample  ROI  Training  Set 


-44- 


5.3  Spectral  Band  Selection 


Pre-selection  techniques  limit  the  initial  set  of  candidate  spectral  bands,  but  they  are 
generally  not  capable  of  determining  the  optimal  set  of  spectral  bands.  For  this  reason, 
further  statistical  analysis  is  required.  As  discussed  in  section  (4.1),  a  number  of  spectral 
band-selection  techniques  exist.  For  the  most  part,  however,  these  existing  studies  have 
been  fairly  limited  in  scope  in  that  each  technique  is  geared  towards  a  specific  image 
type  or  classification  algorithm.  In  many  cases,  the  specific  class  statistics  or  post¬ 
processing  algorithm  are  not  known  a  priori.  The  aforementioned  case-specific 
algorithms,  then,  are  of  limited  value  in  the  predetermination  of  optimal  spectral  bands, 
and  an  algorithm  or  series  of  algorithms  effective  over  a  range  of  scenarios  or 
classification  techniques  would  be  of  tremendous  value. 

The  three  band-selection  algorithms  chosen  for  further  analysis  are  Thresholded 
Divergence  (TD),  Spectral  Basis  Functions  (SBF)  and  Forward  Sequential  Band 
Selection  (FSBS).  Thresholded  Divergence  was  selected  for  its  demonstrated 
effectiveness  when  used  in  conjunction  with  GML  classification.  The  FSBS  technique 
uses  Bayesian  statistics  similar  to  those  used  in  TD,  but  specifically  for  the  task  of  target 
identification  rather  than  landcover  classification.  Finally,  SBF  was  selected  for  its 
mathematical  robustness  and  lack  of  specific  classification  algorithm  for  which  it  was 
intended.  Each  of  the  three  band-selection  techniques  was  applied  to  the  known  or 
predicted  class  statistics  of  the  sample  images  to  select  the  k  best  bands.  The  optimal 
band  sets  selected  by  the  three  techniques  were  compared.  The  images  were  then 
classified  using  GML  for  landcover  classification,  and  SCR  and  Log-Likelihood  Test 
Ratio  for  target  identification.  The  landcover  classification  results  were  used  to 
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construct  confusion  matrices  based  on  both  independent  sampling  and  stratified  random 
sampling  for  analysis  and  comparison.  Similarly,  ROC  curves  were  computed  from 
target-identification  results  based  on  both  independent  sampling  and  stratified  random 
sampling  for  analysis  and  comparison.  In  this  way,  a  direct  comparison  was  made 
between  the  results  of  each  band  selector  for  a  single  image  and  across  the  range  of 
images  with  respect  to  both  landcover  classification  and  target  identification. 

5.3.1  Eigenvector  Pre-Selection  Approach 

While  several  techniques  for  spectral  band  pre-selection  have  been  used,  Rosenblum 
(1990)  demonstrated  that  die  eigenvector  criteria  presented  in  Mausel,  et  al.  (1990) 
produced  the  best  results.  Using  Principal  Components  Analysis,  a  data  set  of  M  spectral 
bands  and  N  pbcels  is  transformed  into  a  set  of  M  orthogonal  eigenvectors,  where  each 
eigenvector  is  a  combination  of  the  original  M  spectral  bands.  These  eigenvectors  are 
ranked  according  to  decreasing  total  variance.  Thus,  the  first  eigenvectors  contain  more 
‘information’  than  then  later  eigenvectors.  Rosenblum  (1990)  suggests  that  the  first  K 
eigenvectors  (those  with  the  greatest  variance)  should  be  examined  for  pre-selection  of 
the  best  K  spectral  bands.  The  band  with  the  largest  positive  or  negative  loading  is  then 
chosen  from  each  eigenvector.  Selecting  one  band  from  each  eigenvector  assures 
minimal  correlation  in  the  selected  set  of  spectral  bands. 

This  eigenvector  approach  to  pre-selection  has  been  integrated  into  the  ENVI™ 
environment  for  direct  use  with  the  input  images  and  class  training  sets.  Eigenvector  Pre- 
Selection  was  intended  to  designate  an  adequate  subset  of  spectral  bands  from  which  an 
optimal  set  could  be  chosen  using  band-selection  algorithms  rather  than  optimize  the  set 
of  spectral  bands  itself  In  the  coiuxe  of  data  collection,  however,  the  eigenvector  pre- 
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selection  algorithm  was  additionally  evaluated  based  on  final  subset  selection  for  each 
image.  The  user  was  required  to  provide  die  appropriate  image  ROI’s  and  the  desired 
spectral  band  subset  size;  ENVI^  outputs  the  selected  spectral  band  names  in  widget 
format  as  illustrated  in  Figure  (15). 


Figure  15:  Sample  Eigenvector  Pre-Selection  Ou^ut 


Band  Selection  Output 


Done 


If  Resize  (Resize  (R15:rsrf6r12.bsq):tank_scene_1m.bsq) 
jC  Resize  (Resize  (R14:tsff6r12.bsq):tank_scene_1m.bsqj 
||  Resize  (Resize  (R3:fsff6f12.bsq):lank_scene_1m.bsq) 
i|  Resize  (Resize  (R9:rsrf6r1Zbsqj:lank_scene_1m.bsqj 
If  Resize  (Resize  (R12:tsffGr1Zbsq):tank_scer»e_1m.bsq) 
II  Resize  (Resize  (R1:rsrf8r12.bsq);lank_scene_1m.bsq) 
Resize  (Resize  fR2:rsff6f12.bsq1:tank_scene  1in.bsal 


5.3.2  Thresholded  Divergence 

The  Thresholded  Divergence  (TD)  method  of  band  selection  discussed  in  Section  (4.1.3) 
requires  predetermination  of  the  threshold  value  d^^esh  used  to  separate  features. 
Rosenblum  (1990)  arbitrarily  selected  a  value  of  1 .0  x  10  '^  for  P(X\{),  the  probability  of 
misclassification,  so  that  the  calculated  threshold  distance  would  be  greater  than  the 
calculated  distance  between  class  means  in  most  cases.  If  the  threshold  distance  was  not 
greater  than  the  calculated  distance  between  the  class  means,  multiple  subsets  would 
produce  the  same  maximum  value  and  the  algorithm  would  be  unable  to  distinguish 
between  subsets.  Rosenblum  (1990)  is  careful  to  point  out  that  the  selected  value  for 
P(X|/)  was  not  meaningful  since  the  assumption  of  normally  distributed  variables  was 
violated.  This  study  designated  the  TD  process  using  P(X|z3=l  .0  x  10"^*  as  TD  original. 
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A  variation  on  the  TD  procedure  introduced  by  Rosenblum  (1990)  was  also  investigated 
in  the  course  of  this  study.  This  variation  referred  to  as  TD  Modified  specifically 
addressed  those  cases  in  which  the  actual  distance  between  the  class  means  was  greater 
than  the  threshold  distance,  resulting  in  values  for  drano  greater  than  1 .0.  In  Rosenblum 
(1990),  A^atio  values  greater  than  1 .0  were  set  equal  to  1 .0.  In  TD  Modified,  the 
stipulation  that  values  greater  than  1.0  be  set  equal  to  1.0  was  eliminated. 


Both  of  the  TD  variations  were  integrated  into  the  ENVI™  environment.  In  each  case, 
the  user  was  required  to  provide  the  image  with  appropriate  ROI’s,  the  desired  spectral 
band  subset  size,  and  the  probability  of  misclassification,  P(X\i).  The  first  input 
parameter  widget  shown  in  Figure  (16)  allowed  the  user  to  select  the  appropriate  image 
and  specify  the  TD  input  spectral  band  subset  resulting  fi'om  the  Eigenvector  Pre- 


Figure  16:  Thresholded  Divergence  Input  Parameter  Widget 
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Selection  algorithm  output.  The  second  input  parameter  widget  shown  in  Figure  (17) 
allowed  the  user  to  input  the  remaining  parameters  as  well  as  the  desired  output 
filename.  The  TD  algorithm  output  the  subset  band  names  in  a  widget  similar  to  that 
shown  in  Figure  (15).  For  TD  Threshold,  a  separate  threshold  determination  routine  was 
run  prior  to  the  TD  routine.  This  routine  simply  required  the  input  image  with 
appropriate  ROI’s.  Calculated  values  for  the  probability  of  misclassification,  P(X1/),  and 
threshold  were  printed  in  the  IDL™  command  window. 


Figure  17;  Thresholded  Divergence  Input  Parameter 
Widget 
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5^.3  Forward  Sequential  Band  Selection 

The  Forward  Sequential  Band  Selection  technique  was  integrated  into  the  ENVI™ 
environment.  The  routine  simply  required  an  input  image  with  appropriate  ROI’s  and 
the  desired  spectral  band  subset  size.  Input  parameter  widgets  were  similar  to  those  used 
in  the  TD  routine  discussed  in  Section  (5.3.2).  The  output  subset  spectral  band  names 
were  presented  in  a  widget  similar  to  that  illustrated  in  Figure  (15). 
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5.3.4  Spectral  Basis  Functions 

The  Spectral  Basis  Function  technique  as  presented  in  Section  (4.1.5)  was  integrated  into 
the  ENYI"^  environment  and  applied  to  each  of  the  four  sample  images.  The  routine 
required  an  input  image  (no  ROI’s  were  required  in  this  method),  the  original  number  of 
bands  in  the  input  image  or  input  image  subset,  the  spectral  band  information  file  name, 
the  spectral  range  averaging  number,  and  the  desired  spectral  band  subset  size  as  is 
shown  in  Figure  (18).  The  spectral  band  information  file  for  each  image  was  built  within 
IDL™ .  It  consists  of  a  2-dimensional  array  whose  members  are  the  minimum  and 
mayimiiin  wavelength  values  for  each  input  image  spectral  band.  The  information  file  is 
a  variation  on  the  .wav  files  which  accompany  Hydice  imagery.  The  spectral  averaging 
number  is  the  fixed  number  over  which  the  input  spectrum  is  averaged  in  the  course  of 
initial  interval  selection  discussed  in  Section  (4.1.5).  The  routine  output  initial  interval 
selection  results  in  the  IDL™  window.  Basis  function  results  for  each  iteration  were 


Figure  18:  Spectral  Basis  Input  Parameter  Widget 


-50- 


output  in  widget  format  as  shown  in  Figure  (19)  where  the  user  was  able  to  click  OK  to 
continue  with  another  iteration,  or  click  CANCEL  to  end  the  routine  and  output  final 
subset  selection  results  to  a  widget. 


Initial  runs  on  all  of  the  sample  images  revealed  results  inconsistent  with  those  suggested 
by  theory  presented  in  Price  (1997).  Both  the  tank  and  desert  scenes  produced  basis 
fimction  values  orders  of  magnitude  less  than  one.  Subsequent  iterations  did  not 
significantly  improve  the  results.  Both  of  the  Hydice  images  produced  basis  function 
values  greater  than  one.  As  a  result,  the  decision  was  made  to  focus  more  specifically  on 


Figure  19:  SBF  First  Iteration  Output  Widget 
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tile  method  used  for  initial  interval  selection.  If  the  initial  interval  selection  was  shown 
to  produce  classification  results  comparable  to  those  obtained  by  tiie  otiier  band  selection 
techniques  imdra*  evaluation,  then  the  SBF  method  would  warrant  a  more  thorough 
examination.  Since  the  initial  interval  selection  results  were  not  comparable  to  those 
obtained  by  the  other  band  selection  techniques,  however,  it  was  concluded  that  the  SBF 
technique  would  not  serve  as  a  strong  candidate  for  optimal  band  selection.  As  a  result,  a 
modified  routine  designed  to  perform  only  initial  interval  selection  was  integrated  into 
the  ENVI™  environment.  This  routine  required  the  same  input  parameters,  although  tiie 
spectral  range  averaging  number  was  set  equal  to  1 .0  for  all  data  runs  in  order  to 
maintain  the  original  bandwidtiis  for  direct  comparison  with  ouq)ut  subsets  firom  the 
other  band  selection  routines.  Due  to  array  size  limitations  and  memory  allocation 
difficulties,  fiill  Hydice  images  could  not  be  used.  Instead,  only  image  band  subsets  based 
on  the  Eigenvector  Pre-Selection  results  were  input  into  the  initial  interval  selection 
routine.  The  tank  and  desert  scenes  were  evaluated  using  both  full  and  subset  image 
spectral  band  sets.  Selected  subset  band  names  were  output  to  a  widget  similar  to  that 
shown  in  Figure  (15). 

5.4  Classification  and  Accuracy  Assessment  Algorithms 

Image  classification  using  Gaussian  Maximum  Likelihood,  Signal-to-Clutter  ratio,  and 
Log-Likelihood  test  ratio  in  the  ENVI™  environment  was  a  straightforward  process. 
GML,  the  only  routine  used  in  the  course  of  this  study  provided  by  ENVI™,  required  the 
user  to  input  the  image  with  landcover  ROI’s  and  select  the  spectral  bands  in  the  subset 
under  evaluation.  The  GML  routine  output  a  class  map  image  ready  for  input  into  both 
the  independent  analysis  and  stratified  random  sampling  confusion  matrix  generation 
routines. 
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The  SCR  algorithm  input  parameter  Figure  20:  Signal-to-Clutter  Input  Parameter 
widget  is  shown  in  Figure  (20).  The 
user  was  required  to  provide  the  input 
image  with  the  target/background  ROI 
set  and  once  again  select  the  spectral 
bands  in  the  subset  under  evaluation. 

Additional  parameters  required  for 
SCR  classification  included  the 
region  of  target  class  representation 
and  the  dueshold  value.  The  region 
of  target  class  representation 
depended  on  how  the  ROI’s  were 
constructed.  The  default  value  was  set  to  1,  in  which  case  ROI  #1  represented  the  target 
class  while  ROI  #2  defined  the  backgroxmd  clutter.  The  threshold  value  was  that  value 
against  which  the  calculated  SCR  value  was  compared.  Pixels  with  SCR  values  greater 
than  the  threshold  were  classified  as  target  pixels,  while  those  resulting  in  values  lower 
than  the  threshold  were  classified  as  background  pixels.  The  user  was  required  to  input 
the  threshold  as  some  percentage  of  the  maximum  image  pixel  value.  For  example,  a 
desired  threshold  of  25  percent  of  the  maximum  image  pixel  value  would  be  entered  as 
simply  0.25.  Each  spectral  band  subset  for  each  image  in  the  sample  set  passed  through 
the  SCR  routine  a  minimum  of  three  times,  varying  the  threshold  value  in  order  to 
acquire  sufficient  data  to  perform  ROC  analysis.  The  SCR  routine  output  a  class  map 
image  ready  for  input  into  both  the  independent  analysis  and  stratified  random  sampling 
ROC  curve  generation  routines. 

The  input  parameters  for  LOG  differ  only  slightly  from  those  required  by  SCR.  The  user 


Widget 
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was  required  to  provide  the  input  image 

with  the  ta^get^ackground  ROI  set  and  Figure  21:  Log-Likelihood  Test  Ratio  Input 

, ,  .  .  Parameter  Widget 

once  agam  select  the  spectral  bands  m  the 

subset  under  evaluation.  Additional 


parameters  shown  in  Figure  (21)  included  |  i  0.05 
the  reainn  nf  target  class  renresentation  as  1 


the  region  of  target  class  representation  as  |  • 

discussed  above,  the  probability  of  the  P'  f 

target  class,  and  the  probability  of  the  | 

background  class.  The  probability  of  the  | :  ' 

target  class  is  the  probability  that  a  j  i 

randomly  selected  pixel  would  be  a  I :  i 

member  of  the  target  class;  the  |  ^ ^  ^  .-.v  r,  r.  |  ^ 

probability  of  the  background  class  is  I , 
most  simply  described  as  ( 1  -probability  | 
of  target  class).  Each  spectral  band 

subset  for  each  image  in  the  sample  set  passed  through  the  LOG  routine  a  minimum  of 
three  times,  varying  the  probability  of  target  and  probability  of  background  values  in 
order  to  acquire  sufficient  data  to  perform  ROC  analysis.  The  LOG  routine  output  a 
class  map  image  ready  for  input  into  both  the  independent  analysis  and  stratified  random 
sampling  ROC  curve  generation  routines. 


Both  the  confusion  matrix  and  ROC  curve  independent  analysis  accuracy  assessment 
routines  required  the  user  to  input  a  truth  image  and  a  class  map  image.  The  truth  image 
was  the  original  image  accompanied  by  a  ROI  set  other  than  that  used  for  classification, 
but  made  up  of  the  same  landcover  or  target/background  classes.  The  confiision  matrix 
generation  routine  output  a  simple  accuracy  confusion  matrix  to  both  the  IDL™ 
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command  window  and  the  user-selected  filename.  The  ROC  generation  routine  output  a 
stimuli/response  metric  in  the  format  shown  in  Table  (2)  to  both  the  IDL™  command 
window  and  the  user-selected  filename. 

The  stratified  random  sampling  accuracy  assessment  routines  were  more  complex.  Both 
required  the  user  to  input  an  original  image,  a  class  map  image,  and  the  desired  number 
of  training  points.  The  ROC  routine  additionally  required  the  user  to  input  the  region  of 
target  class  representation.  The  routine  would  randomly  generate  a  coordinate  set  and 
check  the  selected  pixel’s  class  value  in  the  class  map  image  to  make  sure  that  the 
appropriate  number  of  pixels  were  selected  from  each  class.  A  user  interface  widget 
displayed  the  selected  pixel  coordinates  and  allowed  the  user  to  input  the  pixel’s  true 
class  as  shown  in  Figure  (22).  The  user  could  independently  pinpoint  the  appropriate 
pixel  by  simultaneously  accessing  the  Interactive  Display  ->  Pixel  Locator  option  imder 
the  Functions  menu  in  the  image  display  window  shown  in  Figure  (23).  This  process 
was  repeated  until  tihe  appropriate  number  of  pixels  were  queried  in  each  class.  The 
confiision  matrix  generation  routine  output  a  simple  accuracy  confusion  matrix  to  both 
the  IDL™  command  window  and  the  user-selected  filename.  The  ROC  generation 
routine  output  a  stimuli/response  metric  in  the  format  shown  in  Table  (2)  to  both  the 
IDL™  command  window  and  the  user-selected  filename. 
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Figure  22:  Stratified  Random  Sampling 
Class  Input  Widget 


Figure  23:  Pixel  Locator  Access  Path 
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6.0  Results 


The  test  metric  data  shown  in  Table  (5)  was  collected  for  each  image  in  the  sample  set. 
Two  sets  of  Eigenvector  Pre-Selection  data  were  acquired:  the  first  set  was  an  initial 
down-select  for  use  in  subsequent  band-selection  while  the  second  set  was  a  down-select 
to  the  final  image  subset  for  direct  comparison  with  the  other  band-selection  techniques. 
The  nomenclature  is  as  follows:  the  first  element  describes  the  band  selection  technique, 
the  second  element  describes  the  initial  down-select  band  set  used  by  the  band  selection 
algorithm  under  evaluation,  and  the  final  element  describes  the  ROI  set  used.  Class  1 
describes  the  generic  landcover  class  ROI.  Class2  describes  the  landcover  class  ROI  in 
which  generic  landcover  classes  were  sub-divided.  Tg  refers  to  the  target/background 
ROI  set.  For  example,  TD  orig/pl /class  1  describes  the  subset  acquired  using  the  TD 
original  routine,  the  pre-selection  spectral  band  output  using  class  1,  and  the  class  1  ROI’s. 

Table  5:  Test  metric  for  data  collection. 


Image  Name 


Pre-select  (pl)/classl 

Pre-select  (p2)/class2 

TD  orig/pl /class  1 

TD  mod/p  1/class  1 

FSBS/pl/classl 

TD  orig/p2/class2 

TD  mod/p2/class2 

FSBS/p2/class2 

TD  orig/pl/class2 

TD  mod/pl/class2 

FSBS/pl/class2 

TD  orig/pl/tg 

TD  mod/pl/tg 

FSBS/pl/tg 

TD  orig/p2/tg 

TD  orig/p2/tg 

FSBS/p2/tg 

SBF/pl 

SBF/p2 

SBF/full 

Pre-select/class  1 

Pre-select/class2 

Pre-select/tg 
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Complete  data  sets  for  spectral  band  subsets  of  2  bands  and  4  bands  were  built  for  each 
image.  Each  spectral  band  subset  for  each  complete  data  set  was  classified  and  analyzed 
using  GML,  SCR,  and  LOG  in  conjunction  with  the  appropriate  accuracy  assessment 
metric. 

Each  spectral  band  selection  subset  GML  result  was  entered  into  a  confusion  matrix 
which  was  used  to  compute  a  simple  accuracy  value.  The  subsets  within  an  image  group 
were  then  ranked  from  1  to  3,  where  3  corresponded  to  the  best  results,  2  corresponded  to 
average  results,  and  1  corresponded  to  sub-average  results.  Rankings  were  based  on  tiie 
sample  mean  and  standard  deviation.  Subsets  assigned  a  3  had  GML  simple  accuracy 
values  greater  than  V2  standard  deviation  above  the  mean,  while  those  assigned  a  1  had 
values  less  than  Vi  standard  deviation  below  the  mean.  This  method  was  found  to 
approximate  an  equal  distribution  between  the  three  rankings. 

The  SCR  and  LOG  results  were  used  to  construct  a  stimuli/response  matrix  as  discussed 
in  Section  (4.3.3).  The  probabilities  of  detection  and  false  alarm  for  each  spectral  band 
subset  were  used  to  construct  ROC  curves.  The  ROC  curves  were  compared  based  on 
the  difference  between  the  sum  of  the  probabilities  of  detection  and  the  sum  of  the 
probabilities  of  false  alarm.  Since  an  ideal  target  detector  boasts  a  100  percent 
probability  of  detection  (value  of  1)  and  a  zero  percent  probability  of  false  alarm  (value 
of  0),  those  spectral  band  subsets  with  the  greatest  summed  difference  between  die 
probabilities  of  detection  and  the  probabilities  of  false  alarm  should  be  the  best  target 
detectors.  As  with  the  GML  simple  accuracies,  the  subsets  within  an  image  group  were 
ranked  from  1  to  3,  where  rankings  were  based  on  the  sample  mean  and  standard 
deviation.  Subsets  assigned  a  3  had  difference  values  greater  than  Vi  standard  deviation 
above  the  mean,  while  those  assigned  a  1  had  values  less  than  Vi  standard  deviation 
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below  the  mean.  This  method  was  found  to  approximate  an  equal  distribution  between 
the  three  rankings. 

The  spectral  band  subset  rankings  were  then  entered  into  appropriate  matrices  so  that 
direct  comparisons  between  band  selection  techniques  and  input  parameter  sets  could  be 
made  across  the  range  of  images  and  classification  methods.  The  complete  results  are 
shown  in  Appendix  A. 

6.1  Band  Selection  Results 

6.1.1  Tank  Scene 

The  two-band  subset  selection  results  for  the  tank  scene  are  shown  in  Table  (6).  The 
image  spectral  band  set  was  initially  reduced  from  fifteen  to  five  bands  using  the 
Eigenvector  Pre-Selection  technique.  In  this  case,  the  first  pre-selection  subset  was 
based  on  the  target/background  ROI’s,  whereas  the  second  pre-selection  subset  was 
based  on  die  class2  ROFs.  It  is  interesting  to  note  that  the  initial  pre-selection  outputs 
share  only  two  of  the  five  selected  bands.  This  indicates  that  the  landcover  ROI’s  and 
the  tg/bg  ROI’s  differed  significantly  in  their  respective  spectral  characteristics.  It  is  also 
interesting  to  note  diat  the  output  subsets  for  the  original  and  modified  Thresholded 
Divergence  techniques  differ  for  most  of  the  input  parameter  sets.  In  these  cases,  the 
input  parameter  sets  must  have  produced  d,B,jo  values  greater  than  one. 
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Table  6:  Tank  scene  2-band  results 

p1/tg 

TD  orig/pl/clasi 

TD  mod/pl/clasl 

fsbs/pl/clasi 

1 

1 

1 

3 

3 

9 

3 

'9 

4 

TD  orig/p1/clas2 

TD  mod/pi /clas2 

fsbs/p1/clas2 

7 

4 

1 

3 

9 

7 

3 

9 

TD  orig/p2/clas2 

TD  mod/p2/clas2 

fsbs/p2/clas2 

3 

3 

3 

p2/clas2 

9 

9 

9 

3 

TD  orig/p2/tg 

TD  mod/p2/tg 

fsbs/p2/tg 

9 

3 

3 

3 

12 

15 

9 

12 

14 

TD  orig/pl/tg 

TD  mod/pi /tg 

fsbs/pl/tg 

15 

1 

1 

1 

3 

3 

3 

sbf/pl 

sbf/p2 

sbf/full 

3 

3 

3 

9 

15 

15 

pre-seiect/clasi 

pre-select/clas2 

pre-select/tg 

14 

14 

1 

15 

15 

3 

The  4-band  results  for  the  tank  scene  are  shown  in  Table  (7).  In  this  case,  the  fifteen 
band  image  spectral  band  set  was  initially  reduced  to  eight  bands  using  the  eigenvector 
pre-selection.  The  two  subsets  share  six  of  the  eight  bands.  Calculations  find  the 
correlation  coefficients  between  bands  6  and  7  to  be  0.986,  and  between  bands  12  and  13 
to  be  0.998.  Such  values  approaching  unity  indicate  that  any  differences  between  the 
subsets  should  be  negligible.  With  this  in  mind,  then,  we  should  expect  to  see  similar 
end  classification  accuracies  for  spectral  subsets  which  differ  only  slightly.  One  example 
of  a  group  of  similar  subsets  includes  TD  mod/pl/classl,  TD  mod/pl/class2,  and  TD 
mod/p2/class2.  Subsequent  down-selects  using  the  band  selection  techniques  under 
evaluation  do  not  indicate  any  clear  trends  between  techniques  or  input  parameters  with 
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respect  to  this  image. 

Table  7:  Tank  scene  4-band  results 


p1/tg 

TD  orig/pl/clasi 

TD  mod/pl/clasi 

fsbs/pl/clasi 

1  9 

1  12 

1  7 

3  9 

3  12 

4  14 

3  12 

6  12 

4  14 

TD  orig/p1/clas2 

TD  mod/p1/clas2 

fsbs/p1/clas2 

7  15 

1  9 

1  7 

3  9 

7  14 

3  12 

7  14 

TD  orig/p2/clas2 

TD  mod/p2/cIas2 

fsbs/p2/clas2 

1  9 

1  6 

3  9 

p2/clas2 

6  14 

3  13 

6  12 

1  9 

TD  orig/p2/tg 

TD  mod/p2/tg 

fsbs/p2/tg 

3  13 

4  9 

1  4 

1  4 

4  14 

6  13 

3  15 

3  6 

6  15 

TD  orig/pl/tg 

TD  mod/pl/tg 

fsbs/pl/tg 

4  7 

1  4 

1  4 

9  13 

3  15 

3  7 

TD  orig/full  sbf/pl 

sbf/p2 

sbf/full 

2  14 

3  14 

3  14 

3  11 

4  15 

9  15 

9  15 

9  15 

FSBS/full 

pre-select/clasi 

pre-select/clas2 

pre-select/tg 

3  9 

3  14 

3  14 

1  7 

6  14 

9  15 

6  15 

3  9 
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6.1.2  Desert  Scene 


The  desert  scene  2-  band  results  are  shown  in  Table  (8).  In  this  case,  five-band  pre¬ 
selection  subsets  of  the  ten-band  image  spectral  band  set  were  identical  for  both  the 
target  and  class2  ROI  sets.  This  result  indicates  that  the  image  as  a  whole  must 
demonstrate  less  statistical  variation  then  the  previously  discussed  tank  scene.  In 
addition,  based  on  this  result,  we  should  not  expect  substantial  variation  between  band 
selection  techniques  or  between  input  parameter  sets  in  subsequent  down-selects.  The 
results  in  Table  (8)  validate  this  expectation.  The  thresholded  divergence  original  and 


Table  8:  Desert  scene  2-band  results 


p1/tg 

TD  orig/pl/clasi 

TD  mod/p  1/clas1 

febs/pl/clasi 

1 

3 

3 

7 

3 

7 

7 

10 

7 

TD  orig/p1/clas2 

TD  mod/p  1/clas2 

fsbs/p1/clas2 

9 

3 

3 

7 

10 

7 

7 

10 

TD  orig/p2/clas2 

TD  mod/p2/clas2 

fsbs/p2/clas2 

le'kieit 

p2/clas2 

■kifkit 

**** 

P1=p2 

TD  orig/p2/tg 

TD  mod/p2/tg 

fsbs/p2/tg 

**** 

**** 

fe-k-kit 

**** 

kkick 

TD  orig/pl/tg 

TD  mod/p  1/tg 

fsbs/p1/tg 

1 

1 

1 

10 

10 

10 

sbf/pl 

sbf/p2 

sbf/full 

3 

**** 

3 

9 

Itfcitlt 

9 

pre-select/clasi 

pre-select/clas2 

pre-select/tg 

3 

3 

3 

7 

7 

7 
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modified  techniques  produce  identical  band  sets  for  each  set  of  input  parameters, 
indicating  that  the  threshold  value  was  sufficient  for  all  input  parameter  sets.  Forward 
sequential  band  selection  joins  thresholded  divergence  original  and  modified  in 
producing  the  same  result  for  class  1  and  class2  ROI  sets. 

The  desert  scene  4-band  results  follow  this  same  trend,  although  with  slightly  less 
uniformity.  Once  again,  the  initial  down-selects  from  ten  bands  to  eight  bands  using 
eigenvector  pre-selection  are  identical  for  the  target  and  class2  ROI’s.  The  subsequent 
down-selects  for  TD  orig ,  TD  mod,  and  FSBS  are  nearly  identical  for  classl  and  class2 


Table  9:  Desert  scene  4-band  results 

p1/tg 

TD  orig/pl/clasi 

TD  mod/p1/clas1 

fsbs/pl/clasi 

1  7 

3  8 

3  7 

2  7 

2  8 

5  10 

5  8 

5  10 

3  9 

TD  orig/p1/clas2 

TD  mod/p1/clas2 

fsbs/p1/clas2 

5  10 

3  8 

3  7 

3  7 

5  10 

5  10 

5  10 

TD  orig/p2/clas2 

TD  mod/p2/clas2 

fsbs/p2/clas2 

**** 

p2/clas2 

«*** 

**** 

**** 

P1=p2 

TD  orig/p2/tg 

TD  mod/p2/tg 

fsbs/p2/tg 

**** 

ititifk 

**** 

TD  orig/full 

**** 

«*** 

***★ 

5  8 

TD  orig/pl/tg 

TD  mod/pl/tg 

fsbs/pl/tg 

6  10 

1  7 

2  9 

1  8 

3  10 

5  10 

7  10 

FSBS/full 

sbf/pl 

sbf/p2 

sbf/full 

4  8 

1  7 

3  7 

7  10 

3  9 

**** 

4  9 

pre-select/clasi 

pre-select/clas2 

pre-select/tg 

1  7 

1  7 

1  7 

3  9 

3  9 

3  10 
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ROI’s.  Analysis  reveals  the  correlation  coefficient  between  bands  2  and  3  to  be  0.991, 
and  between  bands  8  and  10  to  be  0.747.  We  should  not  expect  to  observe  significant 
differences  between  end  classification  accuracies  for  the  various  band  selectors  within 
the  same  input  parameter  set. 

6.1.3  Panel  Scene 

Eigenvector  pre-selection  was  used  on  the  panel  scene  to  initially  select  ten  bands  from 
the  original  210-band  image  spectral  band  set.  The  results  shown  in  Table  (10)  indicate 
that  six  of  the  ten  bands  are  shared,  indicating  greater  statistical  variation  Oian  we  saw  in 
the  desert  scene.  Thus,  the  increased  variability  in  subsequent  down-selection  using  the 
band  selectors  under  evaluation  is  not  unexpected.  No  clear  trends  across  band  selection 
techniques  or  input  parameter  sets  are  immediately  evident  in  the  data. 
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Table  10:  Panel  scene  2-band  results 

p1/clas1 

TD  orig/pl/clasi 

TD  mod/pl/clasi 

fsbs/pl/dasi 

1 

46 

1 

64 

42 

3 

54 

119 

119 

119 

4 

63 

TD  orig/p1/clas2 

TD  mod/p1/clas2 

fsbs/p1/clas2 

7 

64 

54 

64 

42 

9 

119 

63 

119 

119 

TD  orig/p2/clas2 

TD  mod/p2/clas2 

fsbs/p2yclas2 

42 

54 

42 

p2/clas2 

54 

60 

54 

1 

46 

TD  orig/p2/tg 

TD  mod/p2/tg 

fsbs/p2^g 

2 

54 

4 

62 

4 

3 

60 

42 

64 

42 

4 

62 

TD  orig/pl/tg 

TD  mod/p  lAg 

fsbs/pl/tg 

42 

64 

63 

63 

7 

64 

64 

42 

sbf/pl 

sbf/p2 

sbf/full 

63 

60 

♦*** 

64 

64 

pre-select/clasi 

pre-select/clas2 

pre-select/tg 

42 

42 

54 

64 

64 

64 

The  panel  scene  4-band  results  shown  in  Table  (1 1)  are  based  on  the  same  initial 
eigenvector  pre-selection  output  subsets.  In  this  case,  several  observations  are  of 
interest.  Each  of  the  TD  original,  TD  modified,  and  FSBS  subsets  are  identical  for  the 
pl/classl  and  pl/class2  input  parameter  sets,  indicating  little  statistical  variation  between 
the  two  ROI  sets  within  the  pi  spectral  band  subset.  However,  the  significant  variation 
between  subsets  resulting  fi*om  the  p2/class2,  pl/class2,  and  pl/tg  input  parameter  sets 
reinforces  the  expectation  of  statistical  variability  previously  arrived  at  based  on  the  2- 
band  panel  scene  results.  It  is  also  interesting  to  note  that  the  optimal  two  band  subset  is 
not  necessarily  incorporated  into  the  best  four  band  subset. 
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Table  11:  Panel  scene  4-ban(i  results 


p1/clas1 

TD  orig/pl/clasi 

TD  mod/pl/dasi 

febs4)1/clas1 

1 

46 

3  63 

1  64 

42  64 

3 

54 

54  119 

7  119 

54  119 

7 

63 

TD  orig/p1/clas2 

TD  mod/p1/clas2 

febs/p1/clas2 

42 

64 

3  63 

1  64 

42  64 

45 

119 

54  119 

7  119 

54  119 

TD  orig/p2/clas2 

TD  mod/p2/clas2 

febs/p2/clas2 

2  60 

54  62 

42  54 

p2/clas2 

54  64 

60  64 

46  62 

1 

46 

TD  orig/p2Ag 

TD  mod/p2/tg 

fsbs/p2/tg 

2 

54 

2  60 

54  62 

42  54 

3 

60 

54  64 

60  64 

46  62 

4 

62 

TD  orig/pl/tg 

TD  mod/pl/tg 

febs/pl/tg 

42 

64 

7  46 

45  54 

1  42 

42  63 

46  64 

7  119 

sbf/pl 

sbf/p2 

sbf/full 

42  63 

46  62 

46  64 

60  64 

**★* 

pre-select/clasi 

pre-select/clas2 

pre-select/tg 

***★ 

**** 

<**** 

6.1.4  Pasture  Scene 


The  pasture  scene  2-band  eigenvector  pre-selection  subsets  were  constructed  differently 
than  those  of  the  previous  images.  In  this  case,  the  subsets  were  based  on  classl  and 
class2  ROI’s,  where  the  classl  ROI-based  set  was  a  twenty  band  subset  of  the  original 
210  spectral  bands.  The  class2-based  set  was  a  ten  band  subset,  aU  of  which  were 
members  of  the  classl  ROI-based  subset.  It  is  interesting  to  note  that,  in  this  case,  the 
TD  orig  and  TD  mod  produce  identical  results  for  each  input  parameter  set.  This 
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indicates  that  the  input  threshold  value  was  sufficient  and  no  calculated  d„,io  values  were 
greater  than  one.  Correlation  analysis  found  the  correlation  coefficients  to  be  0.918 
between  bands  61  and  62, 0.955  between  bands  62  and  63, 0.999  between  bands  53  and 
54,  and  0.996  between  bands  83  and  84.  Such  values  approaching  1.0  indicate  diat 
similar  bands  sets  should  produce  equivalent  end  classification  accuracies. 


Table  12;  Pasture  scene  2-band  results 

p1/clas1 

TD  orig/pl/clasi 

TD  mod/pl/clasi 

fsbs/pl/clasi 

1  8  57  65 

71 

71 

55 

2  37  61  66 

84 

84 

84 

3  53  62  70 

TD  orig/p1/clas2 

TD  mod/p1/clas2 

fsbs/p1/clas2 

4  54  63  71 

57 

57 

55 

5  55  64  84 

61 

61 

84 

TD  orig/p2/clas2 

TD  mod/p2/clas2 

fsbs/p2/clas2 

57 

57 

61 

p2/clas2 

61 

61 

83 

1  57 

TD  orig/p2/tg 

TD  mod/p2/tg 

febs/p2/tg 

3  61 

63 

63 

62 

53  62 

83 

83 

83 

54  63 

TD  orig/pl/tg 

TD  mod/p  1/tg 

febs/plAtg 

55  83 

66 

66 

62 

70 

70 

84 

sbf/pl 

sbf/p2 

sbf/full 

53 

53 

61 

54 

54 

71 

pre-select/ciasi 

pre-select/clas2 

pre-select/tg 

54 

54 

54 

71 

83 

64 

The  4-band  results  are  shown  in  Table  (13).  The  10-band  eigenvector  pre-selection 
output  is  a  subset  of  the  20-band  set  used  for  the  pasture  scene  2-band  results.  The 
class2-based  set  is  identical  to  that  used  for  the  pasture  scene  2-band  results.  No  clear 
trends  are  immediately  evident  in  the  data. 
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Table  13:  Pasture  scene  4-band  results 


p1/clas1  TD  orig/p1/clas1  TD  mod/p1/clas1  fsbs/p1/cias1 


1  55 

3  63 

54  62 

54  61 

3  61 

53  71 

61  71 

55  71 

4  62 

TD  orig/p1/clas2 

TD  mod/p1/clas2 

fsbs/p1/clas2 

53  63 

1  53 

55  62 

54  61 

54  71 

3  71 

61  71 

55  71 

TD  orig/p2/clas2 

TD  mod/p2/clas2 

fsbs/p2/clas2 

1  54 

57  62 

54  61 

p2/clas2 

3  83 

61  83 

57  83 

1  57 

TD  orig/p2/tg 

TD  mod/p2/tg 

fsbs/p2/tg 

3  61 

3  63 

3  63 

57  63 

53  62 

54  83 

62  83 

62  83 

54  63 

TD  orig/pl/tg 

TD  mod/pl/tg 

fsbs/pl/tg 

55  83 

3  63 

3  63 

54  62 

53  71 

62  71 

55  71 

sbf/pl 

sbf/p2 

sbf/full 

61  63 

61  63 

62  71 

62  83 

pre-select/clasi 

**** 

pre-select/clas2 

***★ 

pre-select/tg 

***« 

•k*** 
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6.2  Comparison  between  Band  Selectors  bv  Image 


Two  and  Four-Band  Case 

The  band  selector  comparison  mean  rank  and  standard  deviation  of  the  ranks  for  each 
image  across  the  classifiers  and  input  parameter  sets  for  the  combined  2  and  4-band 
cases  are  listed  in  Table  (14)  and  plotted  in  Figure  (24).  The  standard  deviation  values 
are  based  on  approximately  twenty  samples.  From  diis  data,  we  can  see  that  the  original 
and  modified  versions  of  thresholded  divergence  produce  the  strongest  average  rank  for 
both  the  tank  and  desert  scenes  across  die  range  of  classifiers  and  input  parameter  sets. 


Table  14:  Band  Selector  Comparison  Results  (2  &  4  Band) 


TD  Orig 

(avg  rank/ 
std) 

TDMod 

(avg  rank/  std) 

FSBS 

(avg  rank/  std) 

SBF 

(avg  rank/std) 

Pre-Select 
(avg  rank/  std) 

Tank 

2.16/0.800 

2.16/0.898 

2.08/0. 909 

1.40/0.507 

1.80/0.775 

Desert 

2.36/0.700 

2.36/0.700 

2.28/0.723 

1.93/0.704 

1.80/0.775 

Panel 

2.28/0.678 

2.16/0.746 

2.36/0.700 

2.30/0.823 

2.31/0.751 

Pasture 

2.03/0.718 

2.30/0.651 

2.20/0.805 

1.85/0.689 

2.15/0.899 

Due  to  the  fundamental  similarities  between  the  two  thresholded  divergence  variations,  it 
is  not  surprising  that,  given  the  appropriate  data  set,  the  two  average  ranks  are  nearly 
identical.  The  difference  between  the  two  methods  is  rooted  in  the  original  thresholded 
divergence  stipulation  (Rosenblum,  1990)  which  states  that  any  values  for  d^ao  greater 
than  1.0  are  set  equal  to  1.0.  Where  the  selected  threshold  value  is  sufficiently  large,  this 
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Figure  24:  Band  Selector  Comparison  by  Image  (2  &  4  Band) 

Band  Selector  Comparison 

2  &  4  Band 

Tank  Scene 
Desert  Scene 
Panel  Scene 
Pasture  Scene 


methodical  difference  should  not  be  an  issue.  This  is  likely  the  situation  we  see  for  the 
tank  and  desert  results  in  Table  (14).  However,  where  the  selected  threshold  value  is  not 
sufficiently  large  given  the  input  parameters,  this  one  condition  can  affect  the  end 
spectral  band  subset  selection.  By  rendering  equal  all  values  for  d^t;,,  greater  than  1 .0 
regardless  of  the  actual  distance,  it  is  possible  for  a  band  subset  with  a  greater  actual 
summed  distance  to  be  overlooked  in  favor  of  another  subset  with  lower  above-threshold 
ratio  values.  This  phenomenon  is  a  likely  explanation  for  the  lower  average  rank  offered 
by  the  original  TD  method  for  the  pasture  scene.  At  the  same  time,  allowing  values  for 
greater  than  1 .0  to  retain  their  true  value  can  permit  inflation  of  the  value  for  the 
sum  of  all  distances  between  classes  (equation )  so  that  inordinately  low  values  are 
averaged  with  high  values,  thereby  resulting  in  a  false-high  sum  and  subsequent  selection 
of  a  sub-optimal  spectral  band  set.  This  is  likely  the  reason  why  the  modified  TD 
average  rank  is  significantly  lower  than  the  original  TD  average  rank  for  the  panel  scene. 
It  is  this  conflict  which  may  result  in  inconsistencies  between  the  two  techniques. 
Relatively  high  standard  deviation  values  indicate  non-negligible  variability  within  the 
spectral  band  selection  results  for  each  method. 
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While  FSBS  serves  as  the  top  overall  performer  for  the  panel  scene  and  TD  Mod 
performs  well  for  the  pasture  scene,  eigenvector  pre-selection  used  as  a  full  band  selector 
is  clearly  revealed  to  be  a  strong  performer  for  both  the  panel  and  pasture  scenes. 
Eigenvector  pre-selection  is  based  on  principal  components  analysis  (PCA)  in  which  the 
early  eigenvectors  exhibit  the  largest  variance.  In  hyperspectral  imagery  such  as  the 
panel  and  pasture  scenes,  we  expect  a  high  degree  of  correlation  between  bands.  Thus, 
sufficient  down-selection  using  PCA  should  prove  effective  in  identifying  those  bands 
with  the  greatest  overall  variance  which,  in  turn,  should  prove  to  be  the  same  bands  for 
which  the  distance  between  class  means  is  greatest.  Since  all  of  the  classifiers  are  in 
some  form  dependent  on  the  distance  between  class  means,  those  bands  selected  via 
eigenvector  pre-selection,  assuming  a  sufficiently  small  subset,  should  produce  high 
classification  accuracies.  Additional  observation  reveals  that  the  pre-selection  technique 
boasts  the  lowest  standard  deviation  of  the  average  rank  for  the  panel  scene. 

In  the  2  and  4-band  combined  data  set,  we  do  not  see  a  clear  trend  based  on  image  type; 
while  the  M7  images  demonstrate  the  best  overall  response  to  the  thresholded  divergence 
methods,  the  Hydice  imagery  does  not  consistently  respond  well  to  any  one  band 
selection  technique. 

Two  Band  Case 

The  2-band  results  shown  in  Table  (15)  and  Figure  (25)  differ  from  those  for  the  two  and 
four  band  combined  case,  thereby  implying  a  subset-size  rather  than  an  image-type 
dependence.  For  the  tank  scene,  the  thresholded  divergence  methods  and  eigenvector 
pre-selection  share  the  best  average  rank,  although  eigenvector  pre-selection  appears  to 
have  the  least  variability  within  the  data  based  on  the  standard  deviation  value. 
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Table  15:  Band  Selector  Comparison  Results  (2-Band) 


TD  Orig 

(avg  rank/ 
std) 

TDMod 

(avg  rank/  std) 

FSBS 

(avg  rank/  std) 

SBF 

(avg  rank/std) 

Pre-Select 
(avg  rank/  std) 

Tank 

2.00/0.845 

2.00/0.926 

1.80/1.014 

1.55/0.527 

2.00/0.707 

Desert 

2.13/0.743 

2.13/0.743 

2.20  /  0.414 

2.00/0.866 

1.78/0.972 

Panel 

2.26  /  0.594 

2.20/0.676 

2.33/0.724 

2.00/0.837 

2.55/0.527 

Pasture 

2.13/0.743 

2.13/0.743 

2.06/0.799 

1.86/0.690 

2.33/0.866 

Figure  25:  Band  Selector  Comparison  by  Image  (2-Band) 
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Eigenvector  pre-selection  as  a  strong  technique  seems  logical  given  the  subset  size  and 
input  parameter  set.  As  with  the  Hydice  imagery  in  the  2  and  4-band  case,  it  is  possible 
that  the  ROI’s  are  sufficiently  well-defined  and  the  subset  size  sufficiently  small  so  that 
eigenvector  pre-selection  is  able  to  adequately  identify  those  bands  with  the  greatest 
variance,  which,  in  this  case,  corresponds  to  the  greatest  distance  between  class  means. 

In  contrast,  forward  sequential  band  selection  demonstrates  the  highest  average  rank  with 
the  lowest  variability  for  the  desert  scene.  This  result  is  likely  due  to  the  lower  level  of 
scene  diversity  within  the  image  from  with  ROI’s  could  be  constructed  and  used  for 
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eigenvector  definition.  Despite  these  differences,  it  is  apparent  that  the  thresholded 
divergence  techniques  again  produce  solid,  if  not  optimal,  results  for  both  of  the  M7 
images. 

The  two-band  data  set  reveals  that  the  Hydice  imageiy  responded  best  to  simple 
Eigenvector  Pre-Selection.  This  trend  is  likely  due  to  the  nature  of  the  image-type 
spectral  bands.  The  Hydice  imagery  with  narrower  bandwidths  and  near-continuous 
coverage  fi-om  0.4  to  2.5  pm  is  expected  to  demonstrate  higher  correlation  between 
bands  and  thus  prove  more  responsive  to  eigenvector  pre-selection  than  the  M7  images 
with  fewer,  wider,  and  non-continuous  bandwidths. 

Four-Band  Case 

As  with  2-band  or  the  2  and  4-band  combined  image  data,  no  clear  trend  seems  to  exist 
between  image  or  scene  type  and  band  selector  for  the  4-band  case.  From  Table  (16)  and 
Figure  (26),  we  see  that  forward  sequential  band  selection  produced  the  highest  average 
rank  for  the  tank  and  panel  scenes,  while  the  desert  and  pasture  scenes  responded  better 


Table  16:  Band  Selector  Comparison  Results  (4-Band) 


TDOrig 

(avg  rank/ 
std) 

TDMod 

(avg  rank/  std) 

FSBS 

(avg  rank/  std) 

SBF 

(avg  rank/std) 

Pre-Select 
(avg  rank/  std) 

Tank 

2.40  /  0.699 

2.40/0.843 

2.50/0.527 

1.16/0.408 

1.50/0.836 

Desert 

2.70  /  0.483 

2.70/0.483 

2.40/0.966 

1.83/0.408 

1.83/0.408 

Panel 

2.30/0.823 

2.10/0.875 

2.40/0.699 

2.00/0.816 

1.75/0.957 

Pasture 

1.93  /  0.704 

2.46/0.516 

2.33/0.816 

1.83/0.753 

1.75/0.957 
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to  the  thresholded  divergence  methods.  In  addition,  for  both  the  tank  and  the  panel 
scenes,  forward  sequential  band  selection  resulted  in  the  lowest  variability  within  the 
respective  data  sets.  That  the  highest  average  rank  for  the  tank  scene  swapped  from  the 
thresholded  divergence  methods  for  the  2-band  case  to  FSBS  for  the  4-band  case,  while 
for  the  desert  scene,  the  highest  average  rank  reverse-swapped  from  FSBS  for  the  2-band 

Figure  26:  Band  Selector  Comparison  by  Image  (4-Band) 
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case  to  the  thresholded  divergence  methods  for  the  4-band  case  indicates  a  greater 
dependence  on  subset  size  than  image  type  for  the  thresholded  divergence  and  FSBS 
band  selectors.  This  observation  is  supported  by  the  eigenvector  pre-selection 
technique’s  drop  for  the  tank  scene  from  a  top  band  selector  for  the  2-band  case  to  a  sub¬ 
average  band  selector  for  the  4-band  case. 
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6.3  Comparison  by  Number  of  Bands 


The  mean  rank  and  standard  deviation  for  each  band  selection  technique  across  the  range 
of  scenes  and  input  parameter  sets  shown  in  Table  (17)  and  Figure  (27)  support  the 
subset-size  dependency  identified  above.  The  data  indicate  a  clear  shift  fi-om  eigenvector 
pre-selection  as  the  top  overall  performer  for  the  2-band  case  to  the  modified  thresholded 
divergence  and  FSBS  techniques  for  the  4-band  case.  That  eigenvector  pre-selection 
deteriorates  with  increased  subset  size  is  not  surprising.  As  the  subset  size  increases,  the 
lower-level  eigenvectors  included  in  the  selection  by  pre-selection  have  lower  variance 
and  are  less  likely  to  directly  correspond  to  the  bands  which  maximize  the  distance 
between  class  means. 


Table  17:  Band  Selector  Comparison  by  Number  of  Bands 


TD  Orig 

(avg  rank/  std) 

TDMod 

(avg  rank/  std) 

FSBS 

(avg  rank/  std) 

SBF 

(avg  rank/std) 

Pre-Select 

(avg  rank/  std) 

2  Band 

2.13/0.724 

2.12/0.761 

2.10/0.787 

1.93/0.772 

2.16/0.798 

4  Band 

2.29  /  0.727 

2.42/0.690 

2.40/0.751 

1.68/0.646 

1.70/0.651 

Figure  27:  Band  Selection  Comparison  by  Subset  Size 
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6.4  Comparison  bv  Classifier 


Based  on  theory,  it  is  expected  that  both  the  Gaussian  maximiun  likelihood  and  signal-to- 
clutter  ratio  classifiers  should  respond  best  to  spectral  band  subsets  selected  by  the 
thresholded  divergence  techniques.  This  seems  logical  since  all  three  techniques  are 
based  on  the  multivariate  distance  between  class  means  as  determined  by  the 
Mahalanobis  distance.  The  log-likelihood  classifier,  which  is  based  on  related  Bayesian 

Table  18:  Band  Selector  Comparison  Results  by  Classifier  (2  Band) 


TDOrig 
(avg  rank/  std) 

TDMod 
(avg  rank/  std) 

FSBS 

(avg  rank/  std) 

SBF 

(avg  rank/std) 

Pre-Select 
(avg  rank/  std) 

GML 

1.90/0.641 

1.85/0.671 

2.10/0.788 

1.80/0.632 

2.33/0.778 

SCR 

2.30/0.571 

2.30/0.657 

1.85/0.671 

1.70/0.675 

2.08/0.900 

LOG 

2.20  /  0.894 

2.20/0.894 

2.35/0.813 

2.27/0.904 

2.08  /  .793 

statistics  should  respond  well  to  either  thresholded  divergence  or  the  Bayesian-based 
forward  sequential  band  selector. 

The  results  shown  in  Tables  (18),  (19),  and  (20)  as  well  as  Figures  (28),  (29),  and  (30  ) 
reveal  both  subset-size  and  classifier-type  dependencies.  Gaussian  maximum  likelihood 
responds  best  to  the  eigenvector  pre-selection  subset  for  the  2-band  case.  For  the  4-band 
case,  however,  the  eigenvector  pre-selection  subset  results  in  a  sub-average  response, 
while  the  original  thresholded  divergence  subset  provides  the  highest  average  rank.  As 
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Figure  28:  Band  Selector  Comparison  by  Classifier  (2  Band) 
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in  previous  comparisons,  the  decreasing  success  of  eigenvector  pre-selection  with 
increased  subset-size  seems  logical  since  the  latter  principal  components  display  less 
variance  which  can  be  directly  translated  to  multivariate  distance  between  class  means 
than  their  earlier  counterparts.  It  is  interesting  to  note  that  while  FSBS  is  not  a  top 
performer  in  either  the  2-band  or  the  4-band  case,  it  surfaces  as  the  best  overall 
performer  when  used  in  conjunction  with  GML  classification  for  the  2  and  4-band  case. 

The  signal-to-clutter  ratio  results  experience  a  less  drastic  change  as  the  subset  size  is 
increased.  Unlike  its  GML  counterpart,  SCR  demonstrates  the  strongest  response  to  both 
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Table  19:  Band  Selector  Comparison  Results  by  Classifier  (4  Band) 


TD  Orig 
(avg  rank/  std) 

TDMod 
(avg  rank/  std) 

FSBS 

(avg  rank/  std) 

SBF 

(avg  rank/std) 

Pre-Select 
(avg  rank/  std) 

GML 

2.65  /  0.489 

2.30/0.733 

2.50/0.761 

1.40/0.516 

1.70/0.823 

SCR 

2.10/0.788 

2.55  /  0.686 

2.25  /  0.786 

1.90/0.738 

1.70/0.675 

LOG 

1.60/0.548 

2.40/0.548 

2.60/0.548 

2.00/0.000 
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Band  Selector  Comparison  by  Classifier 
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of  the  thresholded  divergence  output  band  subsets  for  the  2-band  case.  As  the  subset  size 
is  increased  to  4  bands,  the  modified  thresholded  divergence  result  remains  strong,  while 
the  original  thresholded  divergence  result  slips.  This  effect  is  due  to  insufficient 
threshold  values  for  the  4-band  input  parameter  sets.  Nearly  identical  average  ranks  for 
the  2-band  case  indicate  that  the  threshold  values  were  sufficient  for  subset 
determination  using  the  original  TD  technique.  The  non-negligible  difference  between 
the  original  and  modified  TD  average  ranks  for  the  4-band  case  indicates  that  some 
subsets  selected  by  the  modified  TD  technique  must  have  had  d^atio  values  greater  than  1.0 
which  were  set  equal  to  1 .0  and  thus  not  identified  as  optimal.  (See  Section  4.1.3) 
Overall,  for  the  2  and  4-band  case,  the  modified  TD  technique  demonstrated  the  highest 
average  rank  when  used  in  conjunction  with  the  signal-to-clutter  ratio  classifier. 
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Table  20:  Band  Selector  Comparison  Results  by  Classifier  (2  &  4  Band) 


TD  Orig 
(avg  rank/  std) 

TDMod 

(avg  rank/  std) 

FSBS 

(avg  rank/  std) 

SBF 

(avg  rank/std) 

Pre-Select 
(avg  rank/  std) 

GML 

2.27/0.679 

2.08/0.730 

2.30/0.791 

1.60/0.621 

2.02/0.800 

SCR 

2.20/0.687 

2.42  /  0.675 

2.05/0.749 

1.80/0.696 

1.89/0.840 

LOG 

1.90/0.862 

2.30/0.831 

2.48/0.764 

2.14/0.835 

2.08  /  0.793 

Figure  30:  Band  Selector  Comparison  by  Classifier 
'2  &  4  Band) 
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In  contrast  to  the  results  for  the  other  classifiers,  we  see  little  subset-size  dependency 
with  log-likelihood  classification.  It  is  clear  from  Tables  (18),  (19),  and  (20)  that  the 
FSBS  output  subsets  demonstrate  the  highest  average  ranks  for  the  2-band,  4-band,  and  2 
and  4-band  cases.  It  is  interesting  to  note,  however,  that  the  average  rank  for  the  original 
thresholded  divergence  output  subsets  experienced  a  decrease  with  increased  subset  size 
similar  to  that  observed  for  signal-to-clutter  classification. 
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6.5  Overall  Band  Selector  Comparison  Results 


The  average  ranks  for  the  overall  band  selector  comparison  were  calculated  by  averaging 
all  of  the  ranks  for  each  image,  classifier,  and  input  parameter  subset  for  a  given  spectral 
band  selection  technique.  The  results  are  shown  in  Table  (21)  and  Figure  (31).  The  data 
indicate  little  difference  in  both  average  rank  and  standard  deviation  across  the  range  of 
scenes,  classification  techniques,  and  input  parameter  sets  between  the  original 
thresholded  divergence,  modified  thresholded  divergence,  and  forward  sequential  band 
selection  techniques. 


Table  21:  Overall  Band  Selector  Comparison  Results 


TD  Orig 
(avg  rank/  std) 

TDMod 
(avg  rank/  std) 

FSBS 

(avg  rank/  std) 

SBF 

(avg  rank/std) 

Pre-Select 
(avg  rank/  std) 

2.20  /  0.726 

2.25/0.744 

2.23  /  0.794 

1.83/0.727 

2.00/0.798 

Figure  31:  Overall  Band  Selector  Comparison 
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6.6  Comparison  between  Input  Parameter  JSets 


From  previous  analysis,  we  know  that  forward  sequential  band  selection  and  both  the 
original  and  modified  thresholded  divergence  techniques  provide  roughly  equivalent 
average  results  across  a  range  of  scenes,  image  types,  classifiers,  and  input  parameter 
sets.  With  these  band  selectors  in  mind,  the  next  question  is  whether  any  one  input 
parameter  set  or  sequence  of  input  parameters  provides  better  average  results.  The  data 
shown  in  Table  (22)  and  Figure  (32)  suggest  that,  although  the  individual  band  selector 
techniques  do  exhibit  input  parameter  dependencies,  no  one  input  parameter  set  stands 
out  across  the  range  of  band  selectors.  It  is  clear,  however,  that  for  each  individual  band 
selector,  the  optimal  input  parameter  set  was  based  on  pi,  the  initial  eigenvector  pre¬ 
selection  subset  built  using  the  class  1  ROI  set.  Neither  of  the  input  parameter  sets 
incorporating  p2,  the  initial  eigenvector  pre-selection  subset  built  using  the  class2  ROI 
set,  result  in  a  high  average  ranking  for  any  individual  band  selector.  Based  on  this 
observation,  it  seems  that  for  any  image  type  or  band  selector,  best  overall  results  are 
obtained  using  an  initial  down-select  constructed  from  the  most  generic  regions  of 
interest. 


Table  22:  Input  Parameter  Set  Comparison  Results  by  Band  Selector  (2  &  4  Band) 


pl/clasl 
(avg  rank) 

p2/clas2 
(avg  rank) 

pl/clas2 
(avg  rank) 

pl/tg 
(avg  rank) 

p2/tg 
(avg  rank) 

TD  Orig 

2.14 

2.28 

2.33 

2.19 

2.05 

TDMod 

2.48 

2.24 

2.38 

2.19 

1.95 

FSBS 

2.24 

2.24 

2.05 

2.38 

2.24 

Overall 

2.29 

2.25 

2.25 

2.25 

2.08 
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Figure  32:  Input  Parameter  Set  Comparison 
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6.7  Stratified  Random  Sampling  Results 

Classification  accuracies  were  re-examined  for  a  subset  of  the  original  band  selection 
data  set  using  stratified  random  sampling  techniques  in  conjunction  with  GML  and  SCR 
classification.  Previous  analysis  in  Section  (6.5)  revealed  that  Forward  Sequential  Band 
Selection,  and  the  original  and  modified  Thresholded  Divergence  techniques  produce 
similar  results  across  the  range  of  scene  types,  classification  techniques,  and  input 
parameter  sets.  It  was  additionally  found  in  Section  (6.6)  that  each  of  the 
aforementioned  band  selection  techniques  performed  best  with  a  different  input 
parameter  set.  Based  on  these  results,  the  following  input  parameter  sets  were  selected 
for  further  evaluation:  Original  Thresholded  Divergence  using  pi  and  class2.  Modified 
Thresholded  Divergence  using  pi  and  classl,  and  Forward  Sequential  Band  Selection 
using  pi  and  tg.  The  tank  and  desert  scenes  were  used  for  the  additional  analysis. 

The  classification  accuracies  based  on  GML  classification  for  both  images  and  each  of 
the  selected  subsets  are  shown  in  Table  (23).  As  expected,  the  classification  accuracies 
are  lower  for  the  stratified  random  sampling  results.  This  can  be  attributed  to  the  random 
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Table  23:  GML  Stratified  Random  Sampling  Accuracy  Assessment 


Image 

Input  Parameter 
Set 

Independent 

Analysis 
(%  Accuracy) 

Stratified  Sampling 
(%  Accuracy) 

Tank 

Scene 

TDorig/pl/class2 

92.3 

71.0 

TDmod/p  1  /class  1 

89.7 

55.0 

FSBS/pl/tg 

89.7 

55.0 

Desert 

Scene 

TDorig/pl/class2 

85.3 

56.19 

TDmod/pl/classl 

85.3 

56.19 

FSBS/pl/tg 

81.1 

63.11 

nature  of  pixel  selection  and  user  error;  ambiguous  pixels  not  clearly  belonging  to  any 
one  class  were  selected  for  analysis.  For  the  tank  scene  results,  the  TD  orig/pl/class2 
input  parameter  set  produced  better  results  for  both  independent  analysis  and  stratified 
random  sampling  accuracy  assessment  techniques.  The  TD  mod/p  1 /class  1  and 
FSBS/pl/tg  spectral  band  subsets  were  identical  in  this  case.  The  desert  scene  stratified 
random  sampling  results,  on  the  other  hand,  were  not  consistent  with  the  independent 
analysis  results.  Using  independent  analysis,  the  TD  methods  performed  better  than 
FSBS,  while  for  stratified  random  sampling,  the  reverse  was  true.  Despite  this 
discrepancy,  however,  in  both  cases  the  difference  between  the  output  accuracies  is 
within  a  few  percentage  points  and  can,  therefore,  be  considered  negligible. 

The  classification  accuracies  based  on  SCR  classification  for  both  images  and  each  of 
the  selected  subsets  are  shown  in  Table  (24).  In  this  case,  the  stratified  random  sampling 
results  exactly  match  the  independent  analysis  results  for  all  input  parameter  sets  for  both 
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images.  This  result  is  likely  due  to  reduced  ambiguities  between  target  and  background 
spectral  characteristics;  where  some  landcover  classes  can  appear  nearly 
indistinguishable  either  visually  to  the  user  or  spectrally  to  the  algorithm,  target  pixels 
are  typically  more  distinct. 

Table  24:  SCR  Stratified  Random  Sampling  Accuracy  Assessment 


Image 

Input  Parameter 
Set 

Independent 

Analysis 

(%  hit-false  alarm) 

Stratified  Sampling 
(%  hit-false  alarm) 

Tank 

Scene 

TDorig/pl/class2 

-0.47 

-0.47 

TDmod/pl /class  1 

1.0 

1.0 

FSBS/pl/tg 

1.0 

1.0 

Desert 

Scene 

TDorig/pl/class2 

1.85 

1.85 

TDmod/p  1  /class  1 

1.85 

1.85 

FSBS/pl/tg 

-0.23 

-0.23 

In  both  cases,  the  stratified  random  sampling  and  independent  analysis  results  are 
similar.  This  similarity  seems  to  imply  that  the  independent  analysis  results  can  be 
considered  accurate  across  the  range  of  images  and  spectral  band  subsets.  Any 
conclusions  based  on  independent  analysis  results,  then,  can  also  be  considered  reliable. 
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6.8  Correlation  Analysis 


A  final  examination  focused  on  existing  or  potential  correlations  between  Gaussian 
Maximum  Likelihood,  Signal-to-Clutter  Ratio,  and  Log-Likelihood  Test  Ratio 
classification  accuracies.  Linear  regression  was  performed  using  the  rank  values  for  each 
input  parameter  set  for  each  image  with  R  Squared,  the  square  of  the  correlation  between 
the  two  input  variables,  as  the  output.  An  R  Squared  value  of  1.0  indicates  perfect 
correlation,  which  a  value  approaching  zero  indicates  low  correlation  between  the  input 
data  sets.  Results  shown  in  Table  (25)  indicate  the  greatest  correlation  between  GML 
and  SCR  classification  accuracies.  This  seems  logical  since  both  GML  and  SCR  are 
based  on  similar  multivariate  statistics.  Despite  this  association,  however,  none  of  the 
calculated  R  Squared  values  indicate  any  significant  correlation  between  classification 
techniques. 


Table  25:  Correlation  Analysis 


Number  of 
Bands 

Data  Sets 

R^ 

2  Band 

GML/SCR 

0.034 

GML/LOG 

0.00069 

SCR/LOG 

0.00067 

4  Band 

GML/SCR 

0.0013 

-85- 


7.0  Summary  and  Conclusions 


The  goal  of  this  research  was  to  determine  if  any  one  pre-existing  band  selection 
technique  could  consistently  perform  well  across  a  range  of  images,  exploitation 
algorithms,  and  input  parameter  sets  so  that  end  classification  results  based  on  spectral 
band  subsets  selected  without  specific  a  priori  information  would  be  reasonable,  if  not 
optimal.  Test  images  were  selected  to  provide  a  range  of  landcover  and  target  types. 
Regions  of  interest  were  constructed  specifically  to  stress  each  of  the  band  selection 
algorithms  chosen  for  evaluation.  Accuracy  assessment  was  based  on  stratified  random 
sampling  as  well  as  independent  analysis  in  an  effort  to  verify  the  results  upon  which 
these  conclusions  are  based. 

Overall  band  selector  comparison  results  suggest  that,  across  the  range  of  scenarios  and 
classifiers,  the  Thresholded  Divergence  and  Forward  Sequential  Band  Selection 
techniques  produce  roughly  equivalent,  average  results  surpassing  those  of  Eigenvector 
Pre-Selection  and  Spectral  Basis  Fimctions.  No  one  band  selection  technique  stands  out, 
which  is  not  unexpected  in  consideration  of  the  similar  statistical  foundations  fi'om 
which  the  aforementioned  band  selectors  were  developed;  both  Thresholded  Divergence 
and  Forward  Sequential  Band  Selection  are  based  upon  the  multivariate  distance  between 
class  means,  and  both  take  into  account  the  influence  of  individual  class  covariance 
matrices. 

Further  analysis,  however,  provided  insight  into  the  extent  to  which  spectral  band  subset- 
size,  image  and  scene-type,  classifier-type,  and  input  training  regions  impact  individual 
band  selector  performance.  Spectral  band  subset  size  immediately  surfaced  as  a 
potentially  significant  influence.  While  the  overall  performance  of  Thresholded 
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Divergence  and  Forward  Sequential  Band  Selection  improved,  Eigenvector  Pre-Selection 
and  Spectral  Basis  Functions  performance  declined  with  increased  subset  size.  With  fliis 
in  mind,  then,  it  seems  reasonable  that  a  priori  knowledge  of  the  desired  subset  size 
should  impact  appointment  of  a  spectral  band  selection  technique. 

In  contrast,  results  indicate  little  average  rank  dependency  on  image  or  scene-type.  The 
comparison  by  image  data  reveal  clear  shifts  in  the  relative  rankings  of  the  band  selectors 
across  the  range  of  imagery  for  both  the  2-band  and  the  4-band  cases.  Those  shifts  are 
not  consistent  with  either  image-type  or  scene  type,  however,  thereby  implying  that 
neither  image  nor  scene-type  serves  as  a  determining  factor.  Instead,  the  additional  shifts 
in  relative  rankings  which  are  evident  as  the  subset  size  is  increased  fi-om  two  to  four 
bands  point  towards  subset-size  as  die  greater  influence. 

A  similar  conclusion  can  be  made  with  respect  to  any  potential  classifier-type 
dependencies.  Each  classifier  demonstrates  the  best  average  performance  with  used  with 
a  different  band  selector,  and  those  pairings  change  as  the  subset-size  changes.  Thus, 
while  classifier-type  does  influence  the  end  classification  accuracies,  subset  size  once 
again  serves  as  the  greater  influence. 

The  final  parameter  which  seems  to  affect  average  rankings  is  the  input  set  of  training 
regions  and  the  order  in  which  they  are  used.  Comparison  results  reveal  that  each  band 
selector  responds  best  to  a  different  input  parameter  set.  The  one  commonality  across 
the  evaluated  band  selectors  is  found  in  the  initial  down-select;  in  each  case,  the  best 
average  performance  was  obtained  when  the  more  generic  ROI  set  was  used  for  initial 
down-selection.  The  generic  regions  of  interest  must  demonstrate  greater  variances 
which  translate  more  directly  to  the  multivariate  distance  between  class  means  used  for 
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subsequent  band  selection.  Once  initial  down-selection  is  achieved,  however,  each  of  the 
evaluated  band  selectors  performs  best  with  a  different  ROI  set.  Thus,  it  can  be  said  that 
awareness  of  the  input  training  regions  of  interest  can  influence  the  end  classification 
accuracy. 

Based  on  these  observations  and  conclusions,  it  seems  that  a  four-tiered  approach,  a 
schematic  of  which  is  shown  in  Figure  (33),  should  produce  the  best  overall  end 
classification  accuracies.  Spectral  band  subset  size,  as  the  driving  factor,  has  been  shown 
to  influence  classifier,  image,  and  scene-type  dependencies.  For  this  reason,  it  should  be 
decided  upon  first.  Once  subset  size  is  determined,  the  predicted  best  spectral  band 
selection  technique  can  be  chosen  based  on  any  available  classifier,  image,  or  scene-type 
a  priori  information.  Finally,  training  regions  can  be  constructed  to  maximize  the  chosen 
band  selector  performance. 
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Figure  33:  Spectral  Band  Selection  Approach 


-89- 


8.0  Recommendations  for  Future  Work 


This  study  provided  valuable  insight  into  the  question  of  optimal  spectral  band  selection 
in  the  absence  of  a  priori  information.  This  same  insight  has  raised  additional  issues 
worthy  of  study.  The  Spectral  Basis  Functions  band  selection  technique  was  selected  for 
examination  due  to  its  seeming  mathematical  robustness  and  lack  of  specific 
classification  algorithm  for  which  it  was  intended.  In  the  course  of  application,  however, 
difficulties  were  encountered  which,  coupled  with  time  constraints,  mandated  a  modified 
approach  focused  specifically  on  the  method  used  for  initial  interval  selection.  Results 
obtained  using  only  the  initial  interval  selection  technique  did  not  highlight  SBF  as  a 
strong  candidate  for  optimal  band  selection.  However,  it  is  possible  that  a  more  thorough 
examination  of  the  basis  function  development  and  interval  refinement  techniques  might, 
indeed,  reveal  SBF  to  be  a  viable  option  for  spectral  band  selection  in  the  absence  of  a 
priori  information. 

The  subset  size  for  initial  down-selection  using  Eigenvector  Pre-Selection  was 
determined  primarily  based  on  processing  time  and  input  image  constraints.  It  is  not 
known  if  the  subset  size  used  maximized  the  subsequent  down-selection.  A  worthwhile 
study  could  examine  the  question  of  how  many  bands  should  be  pre-selected  and  passed 
on  to  subsequent  band  selection  routines  to  optimize  the  end  result. 

The  question  of  image  and  scene-type  dependencies  was  addressed  in  the  course  of  this 
study.  Due  to  time  and  processing  constraints,  the  data  set  was  limited  to  four  images. 
While  these  images  as  a  group  provided  a  range  of  landcover  and  target  classes,  it  is 
possible  tiiat  a  more  robust  data  set  might  more  clearly  demonstrate  image  or  scene-type 
trends  which  could  be  used  for  selection  of  the  best  spectral  band  selection  technique. 
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It  was  additionally  observed  in  the  course  of  this  study  that  input  training  regions  and  the 
order  in  which  they  are  used  can  significantly  impact  both  band  selection  and  end 
classification  accuracy  regardless  of  the  band  selection  technique.  With  this  in  mind,  it 
seems  that  a  more  thorough  understanding  of  this  phenomena  might  significantly 
enhance  end  results,  particularly  in  the  absence  of  specific  a  priori  information. 

Finally,  several  issues  not  specifically  addressed  by  this  study,  but  worthy  of  examination 
arose  in  the  course  of  discussion.  The  functionality  of  each  of  the  band  selectors  could 
be  assessed  when  used  to  identify  targets  with  very  specific  spectral  signatures  in  a 
localized  region.  A  very  similar  study  could  focus  instead  on  identification  of  ‘hard’ 
targets,  targets  such  as  camouflage  which  are  spectrally  very  similar  to  the  background 
spectral  signature.  Any  of  the  aforementioned  issues  could  incorporate  an  examination 
of  atmospheric  effects  on  band  selection  and  the  end  classification  accuracies. 
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Appendix  A 


Table  A-1:  Tank  Scene  2-Band  Results 


Image  Name 

TANK 

p1/tg 

tdiv  orig/pl/clasi 

tdiv  mod/p1/clas1 

fsbs/pl/clasi 

3 

1 

1 

3 

4 

9 

3 

9 

tdiv  orig/p1/ctas2 

tdiv  mod/p1/clas2 

fsbs/p1/ctas2 

4 

1 

3 

7 

3 

9 

p2/cfas2 

tdiv  orig/p2/cIas2 

tdiv  mod/p2/clas2 

fsbs/p2/cias2 

3 

3 

3 

3 

9 

9 

9 

9 

•  15 

tdiv  orig/p2/tg 

tdiv  mod/p2/tg 

fsbs/p2/tg 

3 

3 

3 

15 

9 

12 

tdiv  orig/pl/tg 

tdiv/p1/tg 

fsbs/pl/tg 

1 

1 

1 

3 

3 

3 

sbfjnt/pl 

sbfjnt/full 

3 

3 

9 

15 

presc/clas1 

presc/tg 

14 

1 

15 

3 
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Table  A-2:  Tank  Scene  2  -Band  Gaussian  Maximum  Likelihood  Confusion  Matrices 

BamJs  1  3 

Tarth 

Parking  Roof  Road  Forest  Driveway  Sand  Circle  NoNamo  Sc/Bush  Sc/Weed  Total 
Parking  74  0  00000000  74 

RoofO  96  0  0  0.0  0  0-0  0  96 

Road  00730700001  81 

Forest  0  0  0203  0  0  0  0  0  0  203^ 

Drivefway  0  0  0  050  0  0  0  0  0  50 

Sand  14  0  0  0  0  91  0  0  0  0  105 

Cirde  00  00006508780 

NoName  20  000  0645  47  0  100 

Sc/Bush  00  000  05  388096 

Sc/Weed  OO  0  00  00  0  0  129  129 

Total  90  96  73  203  57  91  76  48  143  137  89.6957 

RANK  2 
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Truth 


Parking 

Roof 

Road 

Forest 

Driveway 

Sand 

Circle 

NoName 

Sc/Bush 

ScANeed 

Total 

Paridno 

87 

1 

0 

0 

0 

0 

9 

1 

0 

0 

98 

R<^ 

0 

80 

0 

0 

0 

1  - 

0 

0 

4 

1 

86 

Road 

0 

0 

71 

0 

3 

0 

0 

0 

0 

0 

74 

Forest 

0 

0 

0 

203 

0 

0 

0 

0 

0 

0 

203 

Driveway 

0 

0 

1 

0 

54 

0 

0 

0 

0 

1 

56 

Sand 

0 

0 

0 

0 

0 

39 

0 

1 

o' 

0 

40 

Cirde 

3 

3 

0 

0 

0 

0 

60 

2 

0 

4 

72 

NoNattve 

0 

3 

0 

0 

0 

51 

6 

44 

8 

0 

112 

Sc/Bush 

0 

0 

0 

0 

0 

0 

0 

0 

131 

0 

131 

Sc/Weed 

0 

9 

1 

0 

0 

0 

1 

0 

0 

131 
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Total 

90 

96 

73 

203 

57 

91 

76 

48 

143 

137 

88.3218 

2 

3  9 
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Roof 

Road 
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^iveway 

Sand 

Circle 

NoName 

Sc/Bush 
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75 

0 

0 

0 

0 

0 

0 

0 

0 

0 

75 

Roof 

0 

96 

0 

0 

0 

0 

0 

0 

0 

0 

96 

Road 

0 

0 

72 

0 

6 

0 

0 

0 

0 

0 

78 

Forest 

0 

0 

0 

202 

0 

0 

0 

0 

0 

0 
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Driveway 

0 

0 

1 

0 

51 

0 

0 

0 

0 

0 

52 
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0 

0 

0 

0 

0 

85 

0 

0 

0 

0 
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0 

0 

0 

0 
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0 
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0 

0 
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1 

31 

39 

5 

76 
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15 

0 
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1 

0 

6 

8 

17 
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0 
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0 

0 

0 

0 

0 

0 

2 

0 

0 
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90 

96 

73 
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57 

91 

76 

48 
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96 

0 

0 
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0 

0 

0 

96 
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0 

0 

49 

0 

0 

0 

0 

0 

12 
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0 

0 
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0 

1 
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0 
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17 

46 

0 

0 

76 
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0 

0 

1 

0 

0 

5 

0 

1 

129 

0 
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ScANeed 

0 

0 

0 

0 

0 

0 

0 

0 

0 
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Driveway 

Sand 
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NoName 

Sc/Bush 

ScWoed 
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Parking  74 

0 
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0 
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0 
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96  ■ 
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0 
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96 

Road  0 

0 
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0 

0 

0 
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0 

0 

203 

0 

0 

0 

0 

0 
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205 

Driveway  0 
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0 

56 

0 

0 

0 

0 
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57 
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3 
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96 
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0 
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50 
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10 

0 

0 

0 

0 

0 

60 
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0 

0 

0 
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0 
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0 

0 

1 
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0 
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23 

0 

47 

0 

0 
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1 

0 

0 
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84 
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0 

0 

0 

0 
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7 
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48 

0 
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0 
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0 
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0 
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96 
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0 

0 

73 
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0 

0 

0 

0 

0 

80 
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0 

0 
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0 

0 

0 

0 
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0 
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0 

0 
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0 

0 
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52 

0 

0 
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64 

0 
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Parking 

Roof 

Road 

Forest 

Driveway 

Sand 

Circle 

NoName 

Sc^sh 

ScAVeed 

Total 

Paridr>g 

62 

7 

0 

0 

0 

0 

13 

9 

7 

0 

98 

Roof 

0 

3i 

0 

0 

0 

2 

1 

2 

4 

2 

42 

Road 

0 

0 

30 

0 

8 

0 

1 

0 

10 

21 

70 

Forest 

0 

0 

0 

203 

0 

0 

0 

0 

0 

0 

203 

Drrveway 

0 

0 

ta 

0 

44 

0 

0 

0 

0 

70 

132 

Sand 

0 

6 

0 

0 

0 

84 

0 

0 

0 

0 

90 

Cirde 

4 

12 

21 

0 

0 

0 

25 

0 

27 

1 

90 

NoName 

Id 

27 

0 

0 

0 

5 

a 

24 

10 

0 

92 

ScSush 

6 

13 

2 

0 

0 

0 

28 

13 

83 

1 

146 

ScrtA/eed 

0 

0 

2 

0 

5 

0 

0 

0 

2 

42 

51 

Totaf 

90 

96 

73 

203 

57 

91 

76 

48 

143 

137 

61.6290 

1 

4 

7 

St_,conf 

Tr«th 

Parking 

Roof 

Road 

Forest 

Driveway 

Sand 

Circte 

NoName 

Sc/Bush 

Sc/Weed 

Total 

Parking 

2 

0 

0 

0 

0 

0 

0 

0 

0 

0 

2 

Roof 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

Road 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

t 

Forest 

0 

0 

0 

32 

0 

0 

0 

0 

2 

5 

39 

Driveway 

1 

0 

0 

0 

2 

0 

0 

0 

1 

0 

4 

Sand 

1 

0 

0 

0 

0 

4 

0 

0 

3 

0 

6 

Circle 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

NoName 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

5c/8ush 

2 

0 

0 

0 

t 

0 

0 

0 

ia 

2 

23 

Sc/Weed 

0 

0 

0 

6 

0 

0 

0 

0 

4 

13 

23 

Total 

7 

0 

0 

38 

3 

4 

0 

0 

28 

20 

71 

1 

3 

St_corif 

Truth 

Parking 

Roof 

Road 

Forest 

Driveway 

Sand 

Circle 

NoName 

Sc/Bush 

Sc/Weed 

Total 

Patking 

2 

0 

0 

0 

0 

0 

0 

0 

0 

0 

2 

Roof 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

Road 

0 

0 

2 

1 

0 

0 

0 

0 

0 

1 

4 

Forest 

0 

0 

0 

30 

0 

0 

0 

0 

0 

0 

30 

Driveway 

0 

0 

0 

0 

1 

0 

0 

0 

0 

0 

1 

Sand 

0 

0 

0 

0 

0 

8 

0 

0 

2 

0 

10 

Cirde 

0 

0 

0 

0 

0 

0 

1 

0 

3 

3 

7 

NoName 

0 

0 

0 

0 

0 

Q 

0 

1 

10 

3 

14 

Sc/Bush 

0 

0 

0 

0 

0 

0 

0 

0 

7 

2 

9 

ScWeed 

0 

0 

0 

8 

0 

0 

0 

1 

11 

3 

23 

Mean: 

87.58 

Std: 

9.94 

Mean +1/2  std: 

92.55 

Mean  -  Vz  std: 

82.61 

A-5 


Table  A-3:  Tank  Scene  2-Band  -  SCR/LOG  Stimuli/Response  Matrices 


bands  1  9 

3 

9 

3 

16 

1 

3 

3 

12 

4 

714 

16 

9 

12 

threshold  0.25 

0.25 

0.25 

025 

0.25 

025 

025 

0.25 

Rcx:  ei  6 

19 

4S 

67 

0 

68 

1 

7 

60 

67 

0 

0 

67 

52 

15 

0  111 

0 

111 

30 

81 

0 

111 

0 

111 

12 

99 

0 

111 

0 

111 

0.5 

0.5 

0.5 

0.5 

0.5 

0.5 

0.5 

0.5 

0  67 

0 

67 

7 

60 

0 

67 

0 

67 

62 

5 

0 

67 

0 

67 

0  111 

0 

111 

0 

111 

0 

111 

0 

111 

0 

111 

0 

111 

0 

111 

0.05 

0.05 

0.05 

0.05 

0.05 

0.05 

005 

0.05 

67  0 

67 

0 

67 

0 

67 

0 

67 

0 

67 

0 

4 

63 

67 

0 

91  20 

87 

24 

99 

12 

47 

64 

71 

40 

77 

34 

0 

111 

87 

24 

0.05 

0.05 

0.05 

67  0 

67 

0 

67 

0 

0  111 

0 

111 

0 

111 

0.25 

0.25 

0.25 

66  1 

67 

0 

67 

0 

0  111 

0 

111 

0 

111 

0.75 

0.75 

0.75 

0.75 

0.75 

0.75 

0.75 

0.75 

167  6 

175 

0 

175 

0 

66 

1 

67 

0 

66 

1 

40 

135 

62 

5 

0  539 

539 

0 

539 

0 

0 

111 

0 

111 

0 

111 

20 

519 

0 

111 

PM7.075 

67  0 

67 

0 

67 

0 

0  111 

0 

111 

0 

111 

015 

0.15 

Pt=0.15 

167  8 

175 

0 

175 

0 

67 

0 

67 

0 

66 

1 

169 

6 

66 

1 

0  539 

539 

0 

539 

0 

0 

111 

0 

111 

0 

111 

236 

303 

11 

100 

Pt-0.1  . 

0.1 

0.1 

67  0 

175 

0 

175 

0 

67 

0 

67 

0 

67 

0 

173 

2 

66 

t 

0  111 

539 

0 

539 

0 

0 

111 

0 

111 

0 

111 

262 

277 

13 

98 

Table  A-  4:  Tank  Scene  2-Band  SCR  Analysis 
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Table  A-6:  Tank  Scene  4-Band  Results 

image  TAMK-4t>and 

Name 


1 

8 

5 

plA^lasI 

tdiv  orig/p1/clas1 

tdrv 

mod/pi /dasl 

febs/pl/dasi 

t 

9 

3 

12 

1 

1 

3 

4 

14 

4 

3 

6 

7 

15 

12 

7 

9 

14 

12 

12 

9 

Idiv  orig/p  1A3tas2 

Wnr 

mod/p1/das2 

fsbe/p1A:las2 

1 

1 

3 

7 

3 

7 

9 

7 

9 

14 

12 

14 

10 

12 

p2/clas2 

tdrv  orig/p2/c!as2 

tdiv 

tnod/p2/cias2 

fsbs/p2/clas2 

1 

9 

1 

1 

3 

3 

13 

6 

3 

6 

4 

14 

9 

6 

9 

6 

15 

14 

13 

12 

13 

14 

15 

WW  orig/p2ftg 

tdiv  mod/p2Ag 

fsbs/p2Ag 

4 

1 

1 

6 

3 

3 

9 

4 

4 

13 

15 

6 

7 

Mlv  oiig/plAg 

tdiv/plAg 

fsbs/p1/^ 

4 

1 

1 

7 

3 

3 

9 

4 

4 

12 

15 

7 

16 

17 

sfafjnt/pl 

sbfjntffun 

3 

3 

9 

9 

14 

11 

15 

15 

19 

3 

presc/dasi 

preecAg 

tdiv 

orig/fuil/clasf 

2 

4 

14 

15 
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3  1 

9  3 

14  7 

15  9 


Table  A-7:  Tank  Scene  4-Band  GML  Confusion  Matrices 

t 

Truth 


Partdng  Roof 

Road 

Forest 

Driveway  Sand 

Circte 

NoName 

Sc/Bush 

ScAA/eed  Total 

Parking  76 

0 

0 

0 

0 

0 

0 

0 

0 

0 

76 

Roof  6 

96 

0 

0 

0 

0 

0 

0 

0 

0 

96 

Road  0 

0 

71 

0 

0 

0 

0 

0 

0 

0 

71 

Forest  0 

0 

0 

203 

0 

0 

0 

0 

0 

0 

203 

Driveway  0 

0 

2 

0 

57 

0 

0 

0 

0 

Q 

59 

Sand  9 

0 

0 

0 

0 

91 

0 

0 

0 

0 

100 

Circle  0 

0 

0 

0 

0 

0 

69 

0 

0 

0 

69 

NoName  0 

0 

0 

0 

0 

0 

7 

48 

0 

0 

55 

Sc/Bush  5 

0 

0 

0 

0 

0 

0 

0 

143 

0 

148 

ScWeod  0 

0 

0 

0 

0 

0 

0 

0 

0 

137 

137 

Totat  90 

96 

73 

203 

57 

91 

76 

48 

143 

137 

97.25 

3 

2 

Truth 

Parking  Roof 

Road 

Forest  1 

Driveway  Sand 

Circte 

NoName  l 

Sc/Bush  i 

ScAVeed  Total 

Parking  74 

0 

0 

0 

0 

0 

0 

0 

0 

0 

74 

Roof  .  0 

96 

0 

0 

0 

0 

0 

Q 

0 

0 

96 

Road  0 

0 

73 

0 

0 

0 

0 

0 

0 

0 

73 

Forest  0 

0 

0 

203 

0 

0 

0 

0 

0 

0 

203 

Driveway  0 

0 

0 

0 

57 

0 

0 

0 

0 

Q 

57 

Sand  6 

0 

0 

0 

0 

90 

0 

0 

b 

0 

96 

Circle  0 

0 

0 

0 

0 

0 

58 

2 

0 

0 

60 

NoNan^  0 

0 

0 

0 

Q 

0 

18 

46 

0 

0 

64 

Sc/Bush  10 

0 

0 

0 

0 

1 

0 

0 

143 

0 

154 

Sc/Weed  0 

0 

0 

0 

0 

0 

0 

0 

0 

137 

137 

Total  90 

96 

73 

203 

57 

91 

76 

48 

143 

137 

96.87 

1 

3 

Truth 

Parking  Roof 

Road 

Forest  1 

Driveway  Sand 

Circle 

NoName  Sc/Bush  Sc/Weed  Total 

Parking  74 

0 

0 

0 

0 

0 

0 

0 

0 

0 

74 

Roof  0 

96 

0 

0 

0 

0 

0 

0 

0 

0 

96 

Road  0 

0 

71 

0 

0 

0 

0 

0 

0 

1 

72 

Forest  0 

0 

0 

203 

0 

0 

0 

0 

0 

0 

203 

Driveway  0 

0 

2 

0 

57 

0 

0 

0 

0 

0 

59 

Sand  13 

0 

0 

0 

0 

91 

0 

0 

0 

0 

104 

Circle  0 

0 

0 

0 

0 

0 

66 

0 

0 

0 

68 

NoName  0 

0 

0 

0 

0 

0 

8 

48 

0 

0 

56 

Sc/Bush  3 

0 

0 

0 

0 

0 

0 

0 

143 

0 

146 

Sc/Weed  0 

0 

0 

0 

0 

0 

0 

0 

0 

136 

136 

Total  90 

96 

73 

203 

57 

91 

76 

48 

143 

137 

96.86 

o 

4 

£ 

Truth 

Parking  Roof 

Road 

Forest  Driveway  Sand 

Circle 

NoName  Sc/Bush  Sc/Weed  Total 

Parking  87 

0 

0 

0 

0 

0 

0 

0 

0 

0 

87 

Roof  3 

96 

0 

0 

0 

0 

0 

0 

0 

0 

99 

Road  0 

0 

73 

0 

2 

0 

0 

0 

0 

0 

75 

Forest  0 

9 

0 

203 

0 

0 

0 

0 

0 

0 

203 

Driveway  0 

0 

0 

0 

55 

0 

0 

0 

0 

0 

55 

Sand  0 

0 

0 

0 

0 

82 

0 

0 

0 

0 

82 

Circle  0 

0 

0 

0 

0 

0 

70 

3 

0 

0 

73 

NoName  0 

0 

0 

0 

0 

0 

6 

45 

0 

0 

51 

Sc/Bush  0 

0 

0 

0 

0 

0 

0 

0 

143 

0 

143 

ScAAfeed  0 

0 

0 

0 

0 

9 

0 

0 

0 

137 

146 
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5.00 


Truth 


Parldrrg 

Roof 

Road 

Forest 

Drrveway  Sand 

CircJe  1 

Sc/Bush  1 

ScWeed  Total 

Paridrrg 

90.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

90.00 

Roof 

0.00 

96.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

96.00 

Road 

0.00 

0.00 

73.00 

0.00 

1.00 

0.00 

0.00 

0.00 

Ci.00 

0.00 

74.00 

Forest 

0.00 

0.00 

0.00 

203.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

203.00 

Driveway 

0.00 

0.00 

0.00 

0.00 

56.00 

0.00 

0.00 

0.00 

0.00 

0.00 

56.00 

Sand 

0.00 

0.00 

0.00 

0.00 

0.00 

89.00 

0.00 

0.00 

0.00 

0.00 

89.00 

Circte 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

72.00 

0.00 

0.00 

0.00 

72.00 

NoName 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

4.00 

48.00 

0.00 

0.00 

52.00 

Sc/Bush 

0.00 

0.00 

0.00 

0.00 

0.00 

2.00 

0.00 

0.00 

143.00 

1.00 

146.00 

ScWeed 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0-00 

0.00 

0.00 

136.00 

136.00 

Total 

60.00 

96.00 

73.00 

203.00 

57.00 

91.00 

76.00 

48.00 

143.00 

137.00 

98.72 

3.00 

6.00 

Truth 


Parking 

Roof  I 

Road  I 

Forest 

Driveway  Sand  ' 

Circle  1 

NoName 

Sc/Bush  1 

ScWeed  Total 

Paridno 

90-00 

0.00 

0.00 

0.00 

0-00 

0.00 

0.00 

0.00 

0.00 

0.00 

90.00 

Roof 

0.00 

96.00 

0.00 

0.00 

0.00 

0.00 

0:00 

0.00 

0.00 

0.00 

96.00 

Road 

0.00 

0.00 

73.00 

0.00 

0.00 

.  0.00 

0.00 

0.00 

0.00 

0.00 

73.00 

Forest 

0.00 

0.00 

0.00 

203.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

203.00 

Driveway 

0.00 

0.00 

0.00 

0.00 

57.00 

0.00 

0.00 

0.00 

0.00 

0.00 

57.00 

Sand 

0.00 

0.00 

0.00 

0.00 

0.00 

86.00 

0.00 

0.00 

0.00 

QJOO 

86.00 

Oirde 

0.00 

0.00 

OJOO 

0.00 

0.00 

0.00 

67.00 

6.00 

0.00 

0.00 

72.00 

NoName 

Q.OQ 

0.00 

0.00 

0.00 

0.00 

0.00 

9.00 

43.00 

0.00 

0.00 

52.00 

Sc/Bush 

0.00 

0.00 

0.00 

0.00 

0.00 

5.00 

0.00 

0.00 

143.00 

0.00 

148.00 

ScWeed 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

137.00 

137.00 

Total 

90.00 

96.00 

73.00 

203.00 

57.00 

91.00 

76.00 

48.00 

143.00 

137.00 

97.64 

3.00 

T.OO 

Truth 


Parking 

Roof  1 

Road 

Forest 

Driveway  Sand 

D'rcle  { 

NoName 

Sc/Bush  < 

Sc/Weed  Total 

Parking 

74.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

74.00 

Roof 

0.00 

96.00 

0.00 

0.00 

0.00 

Q.OQ 

0.00 

0.00 

0.00 

0.00 

96.00 

Road 

0.00 

0.00 

60.00 

0.00 

8.00 

0.00 

0.00 

0.00 

0.00 

0.00 

68.00 

Forest 

0.00 

0.00 

0.00 

203.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

203.00 

Driveway 

0.00 

0.00 

13.00 

0.00 

49.00 

O.OQ 

0.00 

0.00 

0.00 

0.00 

62.00 

Sand 

13.00 

0.00 

0.00 

0.00 

0.00 

91.00 

0.00 

0.00 

0.00 

0,00 

104.00 

Ckde 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

70.00 

0.00 

0.00 

0.00 

70.00 

NoNarr\e 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

6.00 

48.00 

0.00 

0.00 

54.00 

Sc/Bush 

3.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

143.00 

0.00 

146.00 

ScWeed 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

137.00 

137.00 

Total 

90.00 

96.00 

73.00 

203.00 

57.00 

91.00 

76.00 

48.00 

143.00 

137.00 

9629 

8.00 

Truth 

Parking  1 

Roof  Road  1 

Forest  1 

Driveway  Sand  i 

Circle  NoName  i 

1.00 

Sc/Bush  ScWeed  Total 

Parking 

79.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0,00 

0.00 

0.00 

79.00 

Roof 

0.00 

96.00 

0.00 

0.00 

0.00 

O.OQ 

0.00 

0.00 

0.00 

0.00 

96.00 

Road 

1.00 

0.00 

73.00 

0.00 

1.00 

0.00 

0.00 

0.00 

0.00 

0.00 

75.00 

Forest 

0.00 

0-00 

0.00 

203.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

203.00 

Driveway 

0.00 

0.00 

0.00 

0.00 

56.00 

0.00 

0.00 

0.00 

0.00 

0.00 

56.00 

Sand 

7.00 

0.00 

0.00 

0.00 

0.00 

90.00 

0.00 

0.00 

0.00 

0.00 

97.00 

Cirde 

0.00 

0-00 

0-00 

0.00 

0,00 

0.00 

68.00 

0.00 

0.00 

0,00 

68.00 

ftoName 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

8.00 

48.00 

0.00 

0.00 

56.00 

Sc/Bush 

3.00 

0.00 

0.00 

0.00 

0.00 

1.00 

0.00 

0.00 

143.00 

0.00 

147.00 

ScWeed 

0.00 

0.00 

0.00 

0-00 

0.00 

0.00 

0.00 

0.00 

0.00 

137.00 

137.00 

A-10 


t3,Q0 


Tfutti 


Parfdng  1 

Roof 

Road 

Forest  I 

Driveway  Sand  Circfe  1 

NoName 

Sc^Sush 

ScWeed  Total 

F^iridiyi 

8100 

OPP 

0-PP 

PPP 

PSjO 

PPP 

ppo 

o.pp 

pop 

ppo 

Pipp 

Roof 

8.00 

96.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

Q.OQ 

0.00 

104.00 

Road 

^JOO 

0.00 

73.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

74‘.00 

Fofssi 

0i» 

D-DD 

2JO-00 

DUO 

0-00 

0-00 

0-00 

OPP 

0-DP 

mop 

Driveway 

0.00 

0.00 

0.00 

0.00 

57.00 

0.00 

0.00 

0.00 

0.00 

0.00 

57.00 

Sand 

0.00 

0.00 

0.00 

0.00 

0.00 

81.00 

0.00 

0.00 

0.00 

0.00 

81.00 

Cirde 

DS& 

0-00 

0-00 

OJX) 

O-DO 

D^ 

65-00 

ZDO 

DPO 

O-OP 

a)-D0 

NoName 

0.00 

0.00 

0.00 

0.00 

0.00 

Q.OQ 

8.00 

46.00 

0.00 

0.00 

54.00 

Sc/Bush 

0.00 

0.00 

0.00 

0.00 

0.00 

10.00 

0.00 

0.00 

143.00 

0.00 

153.00 

Sc/Wfi^ 

0-00 

0-00 

0-00 

DSjO 

OJjO 

O-DO 

0-DD 

DJjO 

DPD 

137-DD 

i37i)D 

Total 

90.00 

66.00 

73.00 

203.00 

57.00 

91.00 

76.00 

48.00 

143.00 

137.00 

96.66 

2.00 

Truth 


Paridng  1 

Roof 

Road 

Forest  1 

Driveway  Ssmd  ( 

Circle  1 

NoName 

Sc/Bush  : 

ScAVeod  Total 

.Parking 

.74PP 

P-PP 

PiX) 

PPP 

P-DP 

P-PP 

P-OD 

PPP 

PPP 

D-PP 

74PD 

Roof 

0.00 

66.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

96.00 

Road 

•  0.00 

0.00 

72.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

72.00 

Fpr^ 

P-DP 

P-DP 

P-DP 

2P3PP 

P-DP 

P-DP 

P-DP 

P-DD 

PPP 

P-DD 

23-DD 

Driveway 

0.00 

0.00 

1-00 

0.00 

57.00 

0.00 

0.00 

0.00 

0.00 

0.00 

58.00 

Sand 

13.00 

0.00 

0.00 

0,00 

0.00 

91.00 

0.00 

0.00 

0.00 

.0.00 

104.00 

Oirste 

PPP 

P-PD 

P-PP 

PPP 

P-DP 

PPP 

13-PP 

P-DP 

PPP 

P-DP 

S3-DD 

NoName 

1.00 

0.00 

0.00 

0.00 

0.00 

0.00 

13.00 

48.00 

0.00 

0.00 

62.00 

Sc/Bush 

2.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

143.00 

0.00 

145.00 

6sWe©d 

P-DP 

PJK) 

PPP 

PPP 

PPP 

P-PP 

PPP 

OPD 

PPP 

157-PP 

I37P0 

Total 

90.00 

96.00 

73.00 

203.00 

57.00 

91.00 

76.00 

48.00 

143.00 

137.00 

96.57 

2.00 

Truth 


Paridng  1 

Roof  1 

Road  1 

Forest  I 

Driveway  Sand  Circle  1 

NoName  < 

Sc/Bush  < 

ScAVeed  Total 

.Piirking 

.74PP 

PPP 

P-PP 

PPP 

P-DP 

PPP 

PPP 

P-DP 

PPP 

P-DD 

74jDD 

Roof 

Q.OQ 

96.00 

0.00 

0.00 

0.00 

Q.OO 

Q.OQ 

0.00 

0.00 

0.00 

96.00 

Road 

0.00 

0.00 

61.00 

0.00 

7.00 

0.00 

0.00 

0.00 

0.00 

0.00 

68.00 

.Fi?r¥K?t 

PPP 

PPP 

PPP 

2iypp 

PPP 

PPP 

P-PP 

PPP 

PPP 

ppo 

2P3PP 

Driveway 

Q.OQ 

0.00 

12.00 

0.00 

50.00 

0.00 

0.00 

0.00 

Q.OO 

0.00 

62.00 

Sand 

12.00 

0.00 

0.00 

0.00 

0.00 

90.00 

0.00 

0.00 

0.00 

0.00 

102.00 

Ckcte 

PPP 

P-PP 

PPP 

PPP 

PPP 

PPP 

67PP 

PPP 

PPP 

PPP 

57-PP 

NoName 

1.00 

0.00 

0.00 

0.00 

0.00 

0.00 

6.00 

48.00 

0.00 

0.00 

58.00 

Sc/Bush 

3.00 

0.00 

0.00 

0.00 

0.00 

1.00 

0.00 

0.00 

143.00 

0.00 

147.00 

PPP 

PPG 

PPP 

P-PP 

PPP 

PPP 

PXX) 

PPP 

PPP 

137-00 

137-DD 

Total 

90.00 

96.00 

73.00 

203.00 

57.00 

91.00 

76.00 

4aXK) 

143.00 

137.00 

95.09 

16-90 

Truth 

Paridng  1 

Roof  1 

Road  1 

Forest  I 

Driveway  Sand  Circle  1 

NoName  i 

Sc/Bush  ; 

1.00 

ScA/Veed  To^ 

.Parking 

56.PP 

P-PP 

PPP 

P-PP 

PPP 

PPP 

P-PP 

PPP 

P-PO 

PPP 

5oPP 

Roof 

0.00 

96.00 

0.00 

0.00 

0.00 

0.00 

0,00 

Q.00 

Q.OO 

0.00 

96.00 

Road 

0.00 

0.00 

72.00 

0.00 

0.00 

0.00 

0.00 

OPO 

aoo 

0.00 

72.00 

.Ppr«5t 

P-PP 

PPP 

PPP 

20000 

PPP 

Pi» 

pop 

PPP 

PPP 

PPP 

2SSPD 

Driveway 

0.00 

0.00 

1.00 

0.00 

57.00 

0.00 

0.00 

0.00 

0.00 

0.00 

58.00 

Sand 

0.00 

0.00 

0.00 

0.00 

0.00 

84.00 

0.00 

0.00 

0.00 

0.00 

84.00 

PPP 

pop 

P-PP 

P-PP 

PPP 

P-PP 

P4.pp 

4-PP 

P-PP 

PPP 

TI-PP 

NoName 

0.00 

0.00 

0.00 

0.0Q 

0.00 

0.00 

10.00 

44.00 

0.00 

O.OQ 

54.00 

Sc/Bush 

2.00 

0.00 

0.00 

0.00 

0.00 

7.00 

1.00 

0.00 

143.00 

0.00 

153.00 

Sc/Weed 

2PP 

ppo 

PPO 

P.pp 

PPP 

pop 

.1.00 

P-PP 

P-PP 

134PP 

137-DD 

A-H 


9.00 


Truth 


Parfdng 

Roof  1 

Road  1 

Forest 

Driveway  Sand 

Circie  i 

NoName  i 

Sc/Bush 

ScAAfeed  Total 

Parkirig 

87.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

87.00 

Roof 

0.00 

96.00 

0.00 

0.00 

0-00 

0.00 

0.00 

0.00 

0.00 

0.00 

96.00 

Road 

0.00 

0.00 

73.00 

■  0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

73.00 

Forest 

0.00 

0-00 

0.00 

203.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0-00 

203,00 

Driveway 

0.00 

0.00 

0.00 

0.00 

57.00 

0.00 

0.00 

0.00 

0.00 

0.00 

57.00 

Sand 

0.00 

0.00 

0.00 

0.00 

0.00 

86.00 

0.00 

0.00 

0.00 

0.00 

86.00 

Circle 

0.00 

0.00 

O.GO 

0.00 

0.00 

0.00 

67.00 

3.00 

0.00 

c.oo 

70.00 

NoName 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

9.00 

45.00 

0.00 

0.00 

54.00 

Sc/Bush 

2.00 

0.00 

0.00 

0.00 

0.00 

5.00 

0.00 

0.00 

143.00 

0.00 

150-00 

ScAA/eed 

1.00 

0.00 

o.cc 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

157.00 

138.00 

Total 

90.00 

96.00 

73.00 

203.00 

57.00 

91.00 

76.00 

48.00 

143.00 

137.00 

97.65 

3.00 

10,00 

Truth 


Parking  1 

Roof  1 

Road 

Forest 

Driveway  Sand  ' 

Circle  1 

NoName  : 

Sc/Bush 

ScA/Veed  Total 

Parking 

82.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

O.w 

82.00 

Roof 

0.00 

96.00 

0.00 

Q.0Q 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

96.00 

Road  . 

4.00 

0.00 

73.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

77.00 

Forest 

0.00 

0.00 

0.00 

203.00 

0.00 

0.00 

0.00 

O.GO 

0.00 

G.CO 

203.00 

Driveway 

0.00 

0.00 

0.00 

0.00 

57.00 

0.00 

0.00 

0.00 

0.00 

O-OQ 

57.00 

Sand 

0.00 

0.00 

0.00 

0.00 

0.00 

88.00 

0.00 

0.00 

0.00 

0.00 

88.00 

Circle 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

67.00 

1.00 

o.bb 

0.00 

66.00 

NoName 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

9.00 

47.00 

0.00 

0.00 

56.00 

Sc/Bush 

4.00 

0.00 

0.00 

0.00 

0.00 

3.00 

0.00 

0.00 

143.00 

0.00 

150.00 

Sc/Weed 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

137.00 

137.00 

Total 

90.00 

96.00 

73.00 

203.00 

57.00 

91.00 

76.00 

48.00 

143.00 

13700 

9745 

3.00 

11,00 


Truth 


Parfdng  1 

Roof  1 

Road 

Forest 

Driveway  Sand  ' 

Ctrcfe  1 

I 

I 

5c/Bush  i 

ScAA^eed  Total 

Parking 

74.00 

0.00 

0.00 

0.00 

0.00 

O.GO 

0.00 

0.00 

0.00 

0.00 

74.00 

Roof 

0.00 

96.00 

0.00 

0.00 

O.OQ 

0.00 

0.00 

0.00 

0.00 

0.00 

96.00 

Road 

0.00 

0.00 

69.00 

0.00 

0.00 

0.00 

0.00 

0.00 

4.00 

4.00 

77.00 

Forest 

0.00 

0.00 

0.00 

203.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

203.00 

Driveway 

0.00 

0.00 

0.00 

0.00 

57.00 

0.00 

0.00 

0.00 

0.00 

0.00 

57.00 

Sand 

0.00 

0-00 

0.00 

0.00 

0.00 

90.00 

0.00 

0.00 

0.00 

0.00 

90.00 

Circle 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

61.00 

1.00 

0.00 

0.00 

62.00 

NoName 

1.00 

0.00 

0.00 

0.00 

0.00 

0.00 

15.00 

47.00 

0.00 

0.00 

63.00 

Sc/Bush 

15.00 

0.00 

1.00 

0.00 

0.00 

1.00 

0.00 

0.00 

139.00 

2.00 

158.00 

Sc/Weed 

0.00 

0.00 

3.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0,00 

131.00 

134.00 

Total 

90.00 

96.00 

73.00 

203.00 

57.00 

91-00 

76.00 

48.00 

143.00 

137.00 

94.90 

12.00 

Truth 

Parfdng  1 

Roof  1 

Road  i 

Forest  1 

Driveway  Sand  i 

Circle  1 

NoName  i 

SclBush  i 

1.00 

ScAVeed  Total 

Parking 

74.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

74.00 

Roof 

0.00 

96.00 

0.00 

0.00 

Q.OO 

0.00 

Q.OO 

0.00 

Q.OO 

0.00 

96-00 

Road 

0.00 

0.00 

73.00 

0.00 

1.00 

0.00 

0.00 

0.00 

0.00 

0.00 

74.00 

Forest 

0.00 

0.00 

0.00 

200.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

200.00 

Driveway 

0.00 

0.00 

0.00 

O.OQ 

56.00 

0.00 

0.00 

O.OQ 

O.OQ 

0.00 

56.00 

Sand 

9,00 

0.00 

0.00 

0.00 

0.00 

87.00 

0.00 

0.00 

0.00 

0.00 

96.00 

Circle 

0.00 

0.00 

0.00 

0-00 

0.00 

0.00 

70.00 

0.00 

0.00 

0.00 

70.00 

NoName 

2.00 

0.00 

0.00 

O.QO 

O.OQ 

0.00 

6.00 

48.00 

0.00 

0.00 

56.00 

Sc/Bush 

5.00 

0.00 

0.00 

0.00 

0.00 

4.00 

0.00 

0.00 

143.00 

1.00 

153.00 

ScANeed 

0.00 

0.00 

0.00 

3.00 

0.00 

0.00 

0.00 

0.00 

0.00 

136.00 

139.00 

A-12 


17.00 


Truth 

Parking  1 

Roof  1 

Road  1 

Forest 

Driveway  Sand  i 

Circle 

Paridng 

66.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

Roof 

0.00 

96.00 

0.00 

O.OQ 

0.00 

O.OQ 

Q.OQ 

Road 

0.00 

0.00 

72.00 

0.00 

1.00 

0.00 

0.00 

Forest 

0.00 

0.00 

0.00 

202-00 

0.00 

0.00 

0.00 

Ddveway 

0.00 

0.00 

1.00 

0.0Q 

56.00 

Q.OQ 

0.00 

Sand 

0.00 

0.00 

0.00 

0.00 

0.00 

83.00 

0.00 

Circle 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

67.00 

NoName 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

1.00 

Sc/Bush 

4.00 

0.00 

0.00 

0.00 

0.00 

8.00 

6.00 

ScAWeed 

0.00 

0.00 

0.00 

1.00 

0.00 

0.00 

2.00 

Total 

90.00 

96.00 

73.00 

203.00 

57.00 

91.00 

76.00 

18.00 

Truth 

Parking  1 

Roof  1 

Road  ] 

Forest  1 

Driveway  Sartd  Circle 

Parking 

74.00 

0,00 

0.00 

0.00 

0.00 

0.00 

0.00 

Roof 

0.00 

96.00 

0.00 

0.00 

0.00 

0.00 

0.00 

Road 

0.00 

0.00 

69.00 

0.00 

0.00 

0.00 

0.00 

Forest 

0.00 

0.00 

0.00 

203.00 

0.00 

0.00 

0-00 

Driveway 

0.00 

0.00 

0.00 

0.00 

57.00 

0.00 

0.00 

Sand 

0.00 

0.00 

0.00 

0.00 

0.00 

90.00 

0.00 

Circle 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

61.00 

NoName 

1.00 

0.00 

0,00 

0.00 

0.00 

0.00 

15.00 

Sc/Bush 

15-00 

0.00 

1.00 

0.00 

0.00 

1.00 

0.00 

Sc/Weed 

0.00 

0.00 

3.00 

0.00 

0.00 

0.00 

0.00 

Total 

90.00 

96.00 

73.00 

203.00 

57.00 

91.00 

76.00 

19.00 


Tnith 

Parking  1 

Roof  1 

Road  Forest  Driveway  Sarxt  Circle 

Paridng 

77.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

Roof 

0.00 

96.00 

0.00 

0.00 

0.00 

0.00 

0.00 

Road 

3.00 

0.00 

73.00 

0.00 

8.00 

0.00 

0.00 

Forest 

0.00 

0.00 

0.00 

203.00 

0.00 

0.00 

0.00 

Driveway 

0.00 

0.00 

0.00 

0.00 

49.00 

0.00 

0.00 

Sand 

2.00 

0.00 

0.00 

0.00 

0.00 

88.00 

0.00 

Circle 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

72.00 

NoName 

0.00 

0.00 

0.00 

0.00 

0.00 

c.oo 

4.00 

Sc/Bush 

8.00 

0.00 

0.00 

0.00 

0.00 

3.00 

0.00 

Sc/Weed 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

Total 

90.00 

96.00 

73.00 

203.00 

57.00 

91.00 

76-00 

20.00 

Trutfi 

Paridng  1 

Roof  1 

Road  Forest  Driveway  Sand  Circle  i 

Paridng 

76.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

Roof 

0.00 

96.00 

0.00 

0.00 

0-00 

0.00 

0.00 

Road 

4.00 

0.00 

73.00 

0.00 

0.00 

0.00 

0.00 

Forest 

0.00 

0,00 

0.00 

203.00 

0.00 

0.00 

0.00 

Driveway 

2.00 

0.00 

0.00 

0.00 

57.00 

0.00 

0.00 

Sand 

0.00 

0.00 

0.00 

0.00 

0.00 

89.00 

0.00 

Circle 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

€7.00 

NoName 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

9.00 

Sc/Bush 

8.00 

0.00 

0.00 

0.00 

0.00 

2J00 

0.00 

ScA/Veed 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

NoName  Sc/Bush  ScA/Veed  TcfaJ 


0.00 

0.00 

0.00 

56.00 

0.00 

0.00 

Q.OO 

96.00 

0.00 

0.00 

.  0.00 

73,00 

O.GO 

0-00 

0.00 

202.00 

Q.OQ 

0.00 

0.00 

57.00 

Mean:  96.57 

0.00 

0.00 

0.00 

83.00 

Std:  1.03 

0.00 

0.00 

2.00 

69.00 

46.00 

0.00 

0.00 

49.00 

+1/2  std:  97.08 

0.00 

143.00 

0.00 

161.00 

-1/2  std:  96.05 

0.00 

0.00 

135.00 

138.00 

48.00 

143.00 

137.00 

96.96 

2.00 

NoName  Sc/Bush  Sc/Weed  Total 


0.00 

OSJO 

0.00 

74.00 

0.00 

0.00 

0.00 

96.00 

0.00 

4.00 

4.00 

77.00 

0.00 

0.00 

0.00 

203.00 

0.00 

0.00 

0.00 

57.00 

0.00 

0.00 

0.00 

90.00 

1.00 

0.00 

0.00 

62.00 

47.00 

0.00 

0.00 

63.00 

0.00 

139.00 

2.00 

158.00 

0,00 

0.00 

131.00 

134.00 

48.00 

143.00 

137.00 

94.90 

1-00 

NoName  Sc/Bush  ScAVeed  Total 


0.00 

0.00 

0.00 

77.00 

0-00 

0.00 

0.00 

96.00 

0.00 

0.00 

0.00 

84.00 

0.00 

0.00 

0.00 

203.00 

0.00 

0.00 

0.00 

49.00 

0.00 

0.00 

0.00 

90.00 

2.00 

0.00 

0.00 

74.00 

46.00 

0.00 

0.00 

50.00 

0.00 

143.00 

0.00 

154.00 

0.00 

0.00 

137.00 

137.00 

48.00 

143.00 

137.00 

96.67 

2.00 

NoName  Sc/Bush  ; 

ScAA/eed  Total 

0.00 

0.00 

0.00 

76.00 

0.00 

0.00 

0.00 

96.00 

0.00 

0.00 

0.00 

77.00 

0.00 

0.00 

0.00 

203.00 

0.00 

0.00 

0.00 

59.00 

0.00 

0.00 

0.00 

89.00 

2.00 

0-00 

0.00 

69.00 

46.00 

0.00 

0.00 

55.00 

0.00 

143.00 

1.00 

154.00 

0.00 

0.00 

136-00 

136.00 
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Table  A-8:  Tank  Scene  4-Band  SCR/LOG  Stimnli/Response  Matrices 


Band  1 

sei 

2 

3 

4 

5 

6 

7 

t 

8 

9 

10 

threshS  C  R 
old  0.26 

ROC  0 

67 

0 

67 

0 

67 

14 

53 

16 

51 

0 

67 

0 

67 

13 

54 

0 

67 

0 

67 

0 

111 

0 

111 

0 

111 

0 

111 

0 

111 

0 

111 

0 

111 

0 

111 

0 

111- 

0 

111 

0.1 

10 

57 

1 

66 

1 

66 

64 

3 

65 

2 

22 

45 

65 

1 

66 

1 

58 

9 

63 

4 

12 

99 

0 

111 

0 

111 

0 

111 

0 

111 

30 

81 

0 

111 

0 

111 

31 

80 

28 

83 

0.05 

67 

0 

4 

63 

4 

63 

67 

0 

67 

0 

67 

0 

66 

0 

66 

1 

67 

0 

67 

0 

75 

36 

0 

111 

0 

111 

63 

48 

60 

51 

104 

7 

0 

111 

1 

110 

105 

6 

102  ■ 

-  9 

Log 

0.05 

67 

0 

67 

0 

67 

0 

67 

0 

67 

0 

65 

2 

65 

2 

66 

1 

67 

0 

67 

0 

0 

111 

0 

111 

0 

Ml 

0 

111 

0 

111 

0 

111 

0 

111 

0 

111 

0 

111 

Q 

111 

0.15 

65 

2 

64 

3 

65 

2 

67 

0 

67 

0 

67 

0 

67 

0 

67 

0 

67 

0 

67 

0 

0 

111 

0 

111 

0 

111 

0 

111 

0 

111 

0 

111 

0 

111 

0 

111 

0 

111 

0 

111 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 

SCR  0.25 

0 

67 

67 

0 

64 

3 

66 

1 

0 

67 

0 

67 

Q 

67 

0 

67 

64 

3 

0 

67 

0 

111 

111 

0 

0 

111 

0 

111 

0 

111 

0 

111 

0 

111 

0 

111 

0 

111 

0 

111 

0.1 

1 

66 

66 

1 

67 

0 

66 

1 

17 

50 

4 

63 

54 

13 

1 

66 

66 

1 

54 

13 

0 

111 

0 

111 

41 

70 

7 

104 

0 

111 

0 

111 

0 

111 

0 

111 

0 

111 

29 

82 

0.05 

4 

63 

67 

0 

67 

0 

67 

0 

57 

10 

5 

62 

67 

0 

4 

63 

67 

0 

67 

0 

0 

111 

10 

101 

85 

26 

58 

53 

0 

111 

0 

111 

56 

55 

0 

111 

25 

86 

102 

9 

Log  0.05 

65 

2 

67 

0 

66 

1 

67 

0 

67 

0 

67 

0 

66 

1 

65 

2 

67 

0 

67 

0 

0 

111 

0 

111 

0 

111 

0 

111 

0 

111 

0 

111 

0 

111 

0 

111 

0 

111 

0 

111 

0,15 

65 

2 

87 

0 

66 

1 

67 

0 

67 

0 

67 

0 

66 

1 

65 

2 

67 

Q 

67 

0 

0 

111 

0 

111 

0 

111 

0 

111 

0 

111 

0 

111 

0 

111 

0 

111 

0 

111 

0 

111 
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Table  A-9: 

Tank  Scene  4-Band  SCR  Analysis 

1.00 

2.00 

3.00 

4.00 

5.00 

Hit  False 

Alarm 

Hit 

False 

Alarm 

Hit 

False 

Alarm 

Hit 

False 

Alarm 

Hit 

False 

Alarm 

0.00  0.00 

0.00 

0.00  0.00 

0.00  same  as  2 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

d 

in 

d 

0.04 

0.01  0.00 

0.01 

0.21 

Q.00 

021 

0.24 

O.OQ 

024 

1.00  0-68 

0.32 

0.06  0.00 

0.06 

0.96 

0.00 

0.96 

0.97 

0.00 

0.97 

1.00  1-00 

0.00 

1.00  1.00 

0.00 

1-00 

0.57 

0.43 

1.00 

0.54 

0.46 

0.37 

0.07 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

1.60 

1.67 

3.00 

3.00 

6.00 

7.00 

8.00 

9.00 

10.00 

Hit  False 

Alarm 

Hit 

Falsa 

/yarm 

Hit 

False 

Alarm 

Hit 

False 

Alarm 

Hit 

False 

Alarm 

0.00  0.00 

0.00 

0.00  0.00 

0.00 

0.00  0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.33  0.27 

0.06 

0.99  0.00 

0.99 

0.19  0.00 

0.19 

0-87 

0.28 

0.59 

OS4 

025 

0.69 

1.00  0S4 

0.06 

0.99  0.00 

0.99 

0.99  O.OQ 

0.99 

1.00 

0.95 

0.05 

1.00 

022 

0.08 

1.00  1.00 

0.00 

1.00  1.00 

0.00 

0.99  0.01 

0.93 

1.00 

1.00 

0.00 

1.00 

1.00 

0.00 

0.12 

1.97 

1.00  1.00 

2.16 

0.64 

0-77 

2.00 

3.00 

3.00 

2.00 

2.00 

11.00 

12.00 

13.00 

14.00 

15-00 

K(t  False 

Alarm 

Hit 

False 

Alarm 

Hit 

False 

Alarm 

Hit 

Falsa 

Alarm 

Hit 

False 

Alarm 

same  as2 

0.00  0.00 

0.00 

0.00  0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.99  0.00 

0.99 

0.96  0-00 

0.96 

0.99 

0.00 

0.99 

025 

0.00 

025 

1.00  0.09 

0.91 

1.00  0.37 

0.63 

0.99 

0.06 

0.92 

0.85 

0.00 

025 

1.00  1.00 

0.00 

1.00  0.77 

0.23 

1.00 

0.52 

0.48 

1.00 

1.00 

0.00 

1.89 

1.00  1.00 

1.82 

1.00 

1.00 

2.38 

1-10 

3.00 

3.00 

3.00 

2-00 

16.00 

17.00 

18.00 

19.00 

20.00 

Hit  False 

Alarm 

Hit 

False 

Alarm 

Hit 

False 

Alarm 

Hit 

False 

Alarm 

Hit 

False 

Alarm 

0.00  0.00 

0.00 

0.00  0-00 

0.00  same  as  2 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.06  0.00 

0.06 

0.81  0.00 

0.81 

0.96 

0.00 

0.96 

0.81 

026 

034 

0.07  0.00 

0.07 

1.00  0.50 

0.50 

0.99 

0.00 

0.99 

1.00 

0.92 

0.08 

1.00  1-00 

0.00 

1.00  1.00 

0.00 

1.00 

0.23 

0.77 

1.00 

1.00 

0.00 

0.13 

1.30 

1.00 

1.00 

2.72 

0.63 

1.00 

2.00 

3.00 

1.00 

Mean;  1.07 

Std:  0.89 

Mean  +  Vz  std:  1.52 

Mean  -  Vz  std:  0.63 


Table  A-10:  Desert  Scene  2-Band  Results 


pt«p2 

Miv  orig/p1/c]a52 

fsbs/p1/das2 

tdiv  mo(icias2 

tdivori^^ 

1 

■  3 

7  " 

3 

10 

3 

7 

10 

7 

7 

d 

10 

tdiv  Ofig/pl/clasi 

fsbs/pl/dasi 

tdiv  mod'dasl 

febs/^ 

3 

7 

3 

1 

10 

7 

10 

7 

presc/c}as2 

presc/lg 

sbf- interval 

3 

3 

7 

7 

3 

9 
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Table  A-11:  Desert  Scene  2-Band  Gaussian  Maximum 
Likelihood  Confusion  Matrices 

3  7 


‘tent  sand  vegetation  shadow  canto  des  pavel  des  pav2  despav3  totai 


tent 

3SO.OO 

0.00 

0.00 

0.00 

2.00 

0.00 

3.00 

0.00 

355.00 

sand 

0.00 

113.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

113.00 

vegetation 

0.00 

0.00 

42.00 

0.00 

11.00 

0.00 

0.00 

0.00 

53.00 

shadow 

0.00 

0.00 

0.00 

73.00 

0.00 

0.00 

0.00 

0.00 

73.00 

canto 

0.00 

0.00 

10.00 

0.00 

21.00 

0.00 

0.00 

16.00 

47.00 

despavl 

0.00 

0.00 

0.00 

0.00 

0.00 

365.00 

0.00 

1.00 

366.00 

despav? 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

233.00 

40.00 

273.00 

despavS 

0.00 

0.00 

0.00 

0.00 

0.00 

14.00 

137.00 

159.00 

310.00 

total 

350.00 

113.00 

52.00 

73.00 

34.00 

37S.00 

373.00 

216.00 

85.28 

RANK  2.00 

7  10 


tent  sand  vegetation  shadow  canto  despave1despav2  despavS  total 


tent 

286.00 

0.00 

17.00 

1.00 

i:oo 

0.00 

0.00 

0.00 

305.00 

sand 

0.00 

113.00 

0.00 

0.00 

0.00 

0.00 

0-00 

0.00 

113.00 

vegetation 

4.00 

0.00 

27.00 

0.00 

0.00 

0.00 

0.00 

0.00 

31.00 

shadow 

0.00 

0.00 

0.00 

72.00 

0.00 

0.00 

0.00 

0.00 

72.00 

camo 

60.00 

0.00 

7.00 

0.00 

33.00 

0.00 

6.00 

0.00 

106.00 

des  pavl 

0.00 

0.00 

1.00 

0.00 

0.00 

375.00 

0.00 

0.00 

376.00 

ddspav2 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

322.00 

1.00 

323.00 

des  pav3 

0.00 

0.00 

0.00 

0.00 

0.00 

4.00 

ASJQO 

215.00 

264.00 

total 

350.00 

113.00 

52.00 

73-00 

34.00 

379.00 

373.00 

216.00 

90.75 

3.00 


Mean: 

85.66 

Std: 

3.97 

Mean  +  Vz  std: 

87.64 

Mean  -  Vi  std: 

83.68 
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1  10 


tent  sand  vegetation  shadow  camo  despave1despav2  despavS  total 


tent 

350.00 

0.00 

1.00 

0.00 

0.00 

0.00 

0X30 

aoo 

351.00 

sand 

0.00 

113.00 

0.00 

0.00 

0.00 

0.00 

OJOO 

0.00 

113.00 

vegetE^ 

0.00 

0.00 

37.00 

13.00 

0.00 

0-00 

0.00 

0.00 

50.00 

shadow 

0.00 

0.00 

4.00 

60.00 

Q.OQ 

0.00 

Q.OQ 

Q.OO 

64.00 

camo 

0.00 

0.00 

9.00 

0.00 

1.00 

22.00 

10.00 

0.00 

42.00 

despavl 

0.00 

0.00 

1.00 

0.00 

4.00 

346.00 

27.00 

0.00 

380.00 

despav2 

0.00 

0.00 

0.00 

0.00 

20.00 

7.00 

165.00 

1.00 

193.00 

des  pav3 

0.00 

0.00 

0.00 

0.00 

9.00 

2.00 

171.00 

215.00 

397.00 

total 

350.00 

113.00 

52.00 

3  9 

73.00 

34.00 

379.00 

373.00 

216.00 

81.07 

1.00 

tent 

sand 

vegetation  shadow  camo  des  pave  1  des  pav2  despav3  total 

tent 

350.00 

0.00 

0.00 

0.00 

0-00 

0X30 

0.00 

0.00 

350.00 

sand* 

0.00 

113.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

113.00 

vegeta6on 

0.00 

0.00 

30.00 

5.00 

0.00 

41.00 

11.00 

0.00 

67.00 

shadcw 

0.00 

0.00 

2.00 

68.00 

0.00 

0.00 

0.00 

0.00 

7OJ00 

camo 

0.00 

0.00 

2.00 

0.00 

30.00 

9.00 

1.00 

14.00 

56X30 

des  pavt 

0.00 

0.00 

12.00 

0.00 

0.00 

328.00 

0.00 

0.00 

340.00 

desp3V2 

0.00 

0.00 

5.00 

0.00 

0.00 

0.00 

265.00 

26.00 

296.00 

despavS 

0.00 

0.00 

1.00 

0.00 

4.00 

1.00 

96.00 

176130 

278.00 

total 

350.00  113.00 

st_conf 

tent  sand 

52.00  73.00  34.00  379.00  373.00  216.00 

3  7 

vegetation  shadow  camo  des  pavet  des  pav2  despavS 

65.53 

2.00 

tent 

1.00 

8.00 

0.00 

0.00 

0.00 

0.00 

4.00 

1.00 

14.00 

sand 

1.00 

2.00 

0.00 

1.00 

0.00 

0.00 

0.00 

0.00 

4.00 

veget^ion 

0.00 

0.00 

3.00 

0.00 

0.00 

0.00 

0.00 

0.00 

3.00 

^dcw 

0.00 

0.00 

Q.OQ 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

camo 

0.00 

0.00 

1.00 

0.00 

0.00 

0.00 

0.00 

0-00 

1.00 

des  pavl 

1. 00 

0.00 

0,00 

0.00 

0.00 

29.00 

0.00 

1.00 

31.00 

desp3v2 

2.00 

0.00 

0.00 

0.00 

1.00 

3.00 

17.00 

3.00 

26.00 

des  pav3 

3.00 

0.00 

0.00 

1.00 

0.00 

2.00 

13.00 

7.00 

26.00 

total 

6.00 

st_conf 

10.00 

4.00 

1  10 

2.00 

1.00 

34.00 

34.00 

12.00 

56.16 

tent  sand  < 

vegetetion  shadow  camo  des  pave  1  des  pav2  despav3  total 

tent 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

OOQ 

0.00 

sand 

0.00 

2.00 

0.00 

0.00 

0.00 

0.00 

0.00 

IjOO 

3.00 

vegetation 

0.00 

0.00 

4.00 

0.00 

0.00 

0.00 

1.00 

0.00 

5.00 

shadow 

0.00 

0.00 

0.00 

1.00 

0.00 

0.00 

0.00 

0.00 

1.00 

camo 

0.00 

0.00 

2.00 

2.00 

1.00 

4.00 

4.00 

0.00 

13.00 

despavl 

0.00 

0.00 

0.00 

1.00 

0.00 

19.00 

2.00 

0.00 

22.00 

desp8v2 

0.00 

1.00 

2.00 

0.00 

0.00 

1.00 

13.00 

2jOO 

19.00 

despavS 

3.00 

0.00 

3.00 

0.00 

0.00 

0.00 

9.00 

25.00 

40.00 
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Table  A-12:  Desert  Scene  2-Band  SCR/LOG 
Stimuli/Response  Matrices 


3 

7 

7 

10 

1 

10 

3 

9 

0-25 

0.25 

0.25 

138 

4 

136 

4 

26 

114 

133 

9 

84 

272 

76 

280 

0 

356 

92 

264 

0.15 

0.15 

0.15 

142 

0 

140 

2 

125 

17 

140 

2 

139 

217 

189 

167 

0 

356 

285 

71 

0.5 

0.5 

0.5 

26 

116 

1 

141 

7 

135 

20 

122 

2 

354 

25 

331 

0 

356 

10 

346 

0.05 

0.05 

0.05 

142 

0 

136 

6 

142 

0 

142 

0 

298 

58 

65 

291 

54 

302 

50 

306 

0.1 

0.1 

0.1 

142 

0 

136 

6 

142 

0 

142 

0 

285 

71 

65 

291 

53 

303 

36 

320 

0.25 

0.25 

0.25 

136 

4 

134 

6 

142 

0 

142 

0 

53 

303 

59 

297 

0 

356 

13 

343 
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Table  A-13:  Desert  Scene  2-Band  SCR  Analysis 


cn  (N  On 
(N  'n  00 

CS  O  CN 


o 

5 


Table  A-15:  Desert  Scene  4-Band  Results 


p1/d3s1 

1 

2 

3 

5 


pl^2 


1 

3 

4 

tdivortg/pl/dasl 

tdiv  mod/pi /dasl 

febs/pl/dasi 

3 

3 

2 

5 

5 

5 

8 

7 

7 

10 

8 

10 

10 

11 

tdJv  origAp1/cfas2 

tdiv  mod/pi  Ac{as2 

fsbs/p1/cfes2 

3 

3 

3 

5 

5 

5 

6 

7 

7 

10 

9 

10 

6 

12 

7 

tdivorig^plftg 

tdiv  mod/pi  ftg 

fsbs/p1/^ 

1 

2  ' 

1 

3 

5 

7 

7 

9 

8 

10 

10 

10 

8 

14 

sbfJnVpl 

Bbsnun/dasi 

sbMnt/fufl 

.1 

4 

3 

3 

7 

4 

7 

8 

7 

8 

10 

$ 

13 

presc/clasi 

presc/tg 

.1 

1 

3 

3 

7 

7 

.0 

10 
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Table  A-16:  Desert  Scene  4-Band  Gaussian  Maxinitim 
Likelihood  Confiisioti  Matrices 

t 


tent 

sand 

vi^gatidion  shadow  oamo 

daspava1da5pav2  daspav3 

totel 

tent 

350 

0 

0 

0 

0 

0 

0 

0 

350 

sand 

0 

1t3 

0 

0 

0 

0 

0 

0 

113 

vasstabon 

0 

C 

49 

0 

0 

0 

0 

0 

49 

shadow 

0 

0 

0 

73 

0 

0 

0 

0 

73 

camo 

0 

0 

3 

0 

34 

0 

2 

4 

43 

das  pavl 

0 

G 

0 

0 

0 

377 

0 

0 

377 

despav2 

0 

0 

0 

0 

0 

0 

360 

0 

360 

despavS 

0 

0 

0 

0 

0 

2 

11 

212 

225 

total 

RANK 

350 

113 

52 

73 

2 

34 

3^ 

373 

216 

98.62 

3 

tent 

sand 

vagatadonshadow  camo 

daspava1dsspav2  da$pav3  tote! 

tent 

350 

0 

0 

0 

0 

0 

0 

0 

350 

sand 

0 

113 

0 

0 

0 

0 

0 

0 

113 

vs9«tation 

0 

C 

42 

4 

0 

0 

0 

0 

46 

shadow 

0 

0 

3 

59 

0 

0 

0 

0 

72 

camo 

0 

0 

7 

0 

34 

3 

16 

3 

63 

dospavl 

0 

0 

0 

0 

0 

373 

0 

0 

373 

dasp8\/2 

0 

0 

0 

0 

0 

0 

325 

0 

325 

despav3 

0 

0 

0 

0 

0 

3 

32 

213 

248 

tetai 

350 

113 

52 

73 

34 

379 

373 

216 

95.53 

2 

tent 

sand 

vagstetion  shadow  camo 

das  paval  das  pav2  daspav3 

ioteJ 

tent 

348 

0 

0 

0 

0 

0 

0 

0 

348 

sand 

0 

113 

0 

0 

0 

0 

0 

0 

113 

vagatatlon 

0 

0 

47 

0 

0 

0 

0 

0 

47 

shadow 

0 

0 

0 

73 

0 

0 

0 

0 

73 

camo 

2 

0 

5 

0 

34 

0 

2 

5 

48 

daspavl 

0 

C 

0 

0 

0 

379 

0 

0 

379 

<tespav2 

0 

0 

0 

0 

0 

0 

365 

0 

365 

des  pav3 

0 

0 

0 

0 

0 

0 

6 

211 

217 

totel 

350 

113 

52 

73 

34 

379 

373 

216 

98.74 

tent  wnd  v«9«tetk>n  shadow  camg  <tesp«vs1ttespav2  dsspavS  total 


tent 

350 

0 

0 

2 

0 

0 

0 

0 

352 

sand 

0 

113 

0 

0 

0 

0 

0 

0 

113 

vagatetion 

0 

0 

49 

0 

0 

0 

0 

0 

49 

shadow 

0 

0 

0 

71 

0 

0 

0 

0 

71 

camo 

0 

0 

3 

0 

34 

0 

3 

3 

43 

daspavl 

0 

0 

0 

0 

0 

377 

0 

0 

377 

ctespav2 

0 

0 

0 

0 

0 

0 

336 

1 

337 

despavS 

0 

0 

0 

0 

0 

2 

34 

212 

248 

total 

359 

113 

52 

73 

34 

379 

373 

216 

96.98 

2 


A-22 


5 


tent  send  vegetefion  shadow  came  des  pavel  dee  pav2  despavS  total 


tent 

350 

0 

0 

0 

0 

0 

0 

0 

350 

sand 

0 

113 

0 

0 

0 

0 

0 

0 

113 

vegetation 

0 

0 

4S 

0 

0 

0 

0 

0 

45 

shadow 

0 

0 

0 

73 

0 

0 

0 

0 

73 

camo 

0 

0 

7 

0 

34 

0 

3 

5 

49 

deepavl 

0 

C 

0 

0 

0 

375 

0 

0 

375 

(tespav2 

0 

0 

0 

0 

0 

0 

311 

0 

311 

despav3 

0 

0 

0 

0 

0 

4 

59 

211 

274 

total 

350 

113 

52 

73 

34 

379 

373 

216 

95^9 

tent  eand  vegetation  shadow  oame  dee  pavel  dee  pav2  deepavS  total 


tent 

350 

0 

0 

0 

0 

0 

0 

0 

350 

sand 

0 

113 

0 

0 

0 

0 

0 

0 

113 

vegetation 

0 

0 

46 

0 

0 

0 

0 

0 

46 

shadow 

0 

0 

0 

73 

p 

0 

0 

0 

73 

camo 

0 

0 

6 

0 

34 

0 

0 

4 

44 

dee  pavl 

0 

0 

0 

0 

0 

377 

0 

0 

377 

despav2 

0 

0 

0 

0 

0 

1 

339 

0 

340 

despav3 

0 

0 

0 

0 

0 

1 

34 

212 

247 

tetai 

350 

113 

§2 

73 

34 

379 

373 

216 

97.11 

tent  sand  vegetation  shadow  oamo  dee  pave1  dee  pav2  deepavS  total 


tent 

349 

0 

0 

1 

0 

0 

0 

0 

350 

sand 

0 

113 

0 

0 

0 

0 

0 

0 

113 

vegetation 

C 

0 

43 

1 

0 

0 

0 

0 

44 

^ladow 

0 

0 

0 

71 

0 

0 

0 

0 

71 

canx) 

1 

0 

9 

0 

34 

0 

10 

1 

55 

dee  pav1 

0 

0 

0 

0 

0 

377 

0 

0 

377 

despav2 

0 

0 

0 

0 

0 

0 

359 

0 

359 

despa\<3 

0 

0 

0 

0 

0 

2 

4 

215 

221 

total 

350 

113 

52 

73 

34 

379 

373 

216 

99.18 

tent  eand  vegetation  shadow  oamo  dee  pave  Idee  pav2  despav3  total 


tent 

348 

0 

0 

1 

0 

0 

0 

0 

349 

sand 

0 

113 

0 

0 

0 

0 

0 

0 

113 

vegetation 

0 

0  , 

46 

1 

0 

0 

0 

0 

47 

^xadow 

0 

0 

0 

71 

0 

0 

0 

0 

71 

camo 

2 

0 

6 

0 

34 

0 

0 

1 

43 

deepavl 

0 

0 

0 

0 

0 

378 

0 

0 

378 

despav2 

0 

0 

0 

0 

0 

1 

369 

0 

370 

des  pav3 

0 

0 

0 

0 

0 

0 

4 

215 

219 

totel 

350 

113 

52 

73 

34 

379 

373 

216 

98.99 

3 


A-23 


9 


tent  sand  vogofarfi on  shadow  came  dee  pavel  des  pav2  desjMiv?  total 


tent 

349 

0 

0 

0 

Q 

0 

0 

0 

349 

sand 

0 

lt3 

0 

0 

0 

0 

0 

0 

113 

vegetation 

0 

0 

43 

2 

G 

G 

G 

0 

•  45 

shadow 

0 

0 

0 

71 

0 

0 

0 

0 

71 

camo 

1 

0 

9 

0 

34 

0 

0 

1 

45“ 

des  pavl 

0 

0 

G 

G 

0 

377 

G 

G 

377 

despav2 

0 

0 

0 

0 

0 

1 

364 

0 

365 

des  pav3 

0 

0 

0 

0 

0 

1 

9 

215 

225 

total 

35Q 

113 

62 

73 

10 

34 

379 

373 

216 

9849 

3 

tent 

sand 

vegetation  shadow  camo 

dospavo1despav2  despavS  total 

tent 

346 

0 

0 

0 

0 

0 

0 

0 

346 

sand 

0 

113 

0 

0 

0 

0 

0 

0 

113 

vegetation 

6 

0 

47 

1 

G 

G 

G 

G 

48 

shadow 

0 

0 

0 

72 

0 

0 

0 

Q 

72 

camo 

4 

0 

5 

0 

34 

0 

2 

7 

62 

des  pavl 

0 

G 

G 

0 

G 

3e7 

G 

1 

368 

despava 

0 

0 

0 

0 

0 

Q 

311 

12 

323 

despavS 

0 

0 

0 

0 

0 

12 

ea 

196 

268 

total 

3§0 

113 

62 

73 

34 

379 

373 

216 

9346 

tent  sand  vegetation  shadow  oamo  des  pavel  dee  pav2  despavS  total 


tent 

350 

0 

0 

1 

0 

0 

0 

0 

351 

sand 

0 

113 

0 

0 

0 

0 

0 

0 

113 

vegetation 

G 

0 

46 

G 

G 

G 

G 

G 

46 

shadow 

0 

0 

0 

72 

0 

0 

0 

0 

72 

camo 

0 

0 

6 

0 

34 

0 

3 

4 

47 

des  pavl 

G 

G 

G 

0 

G 

374 

G 

0 

374 

des  pav2 

0 

0 

0 

0 

0 

0 

318 

1 

319 

despavS 

0 

0 

0 

0 

0 

5 

52 

211 

268 

total 

350 

113 

62 

73 

34 

379 

373 

216 

9647 

tent  sand  vegetetion  shadow  came  des  pave  Ides  pav2  despavS  total 


tent 

350 

0 

0 

0 

0 

0 

0 

0 

350 

sand 

0 

113 

0 

0 

0 

0 

0 

0 

113 

vegetation 

G 

0 

48 

6 

0 

G 

0 

G 

64 

shadow 

0 

0 

0 

67 

0 

0 

0 

0 

67 

camo 

0 

0 

4 

0 

34 

6 

19 

4 

67 

dos  pavl 

0 

0 

0 

G 

6 

370 

0 

0 

370 

despav2 

0 

0 

0 

0 

0 

0 

321 

2 

323 

des  pav3 

0 

0 

0 

0 

0 

3 

33 

210 

246 

total 

350 

113 

62 

73 

34 

379 

373 

216 

96.16 

2 
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13 


tent  send  vegetation  shadew  eame  ^pavelciespevS  despavS  toW 


tent 

350 

0 

0 

0 

0 

0 

0 

0 

350 

sand 

0 

113 

0 

0 

0 

0 

0 

0 

113 

vegetation 

0 

0 

43 

0 

0 

0 

0 

'0 

43 

shadow 

0 

0 

0 

73 

0 

0 

Q 

0 

73 

camo 

0 

0 

9 

0 

34 

0 

2 

10 

55 

dee  pevl 

0 

0 

0 

0 

0 

351 

G 

G 

351 

despav2 

0 

0 

0 

0 

0 

0 

281 

10 

291 

des  pav3 

0 

0 

0 

0 

0 

18 

90 

196 

304 

tetel 

3e6 

113 

52 

73 

14 

34 

379 

373 

215 

91^ 

1 

tent 

sand 

vegetation  shadow  eamo 

despave1despav2  despavS  teiai 

tent 

350 

0 

0 

Q 

0 

0 

0 

0 

350 

sand 

0 

113 

0 

0 

0 

0 

0 

0 

113 

vegetation 

0 

0 

44 

0 

9 

0 

G 

G 

44 

shadow 

0 

0 

0 

73 

0 

0 

0 

0 

73 

camo 

0 

0 

8 

0 

34 

0 

0 

4 

46 

des  pevl 

6 

0 

0 

0 

0 

353 

0 

2 

35S 

d6Spav2 

0 

0 

0 

0 

0 

0 

299 

14 

313 

des  pav3 

0 

0 

0 

0 

0 

16 

74 

196 

286 

ietel 

3$0 

113 

52 

73 

34 

379 

373 

215 

92^ 

1 


Mean: 

96.12 

Std: 

2.46 

Mean  +  Vi  std: 

97.35 

Mean  -  Vi  std: 

94.87 
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Table  A- 17:  Desert  Scene  4-Ban)d  SCR/LOG  Stimuli/Response  Matrices 


?  (D  a>  in  N 


00  o  CT  T*  o  o 


<£>  <D  <M  CO  rt 

ft  ’■ 


S  B 


8^ 


s  “  s  ft  a 


O  <0 


^  to  o  so  in  o 


CO  c  CJ 


CO  00  o  o>  o  o 

^  5 


5  in 

cV  era 


g®  g 


8  a  I  g  °  I 


g 


«  s  s  a 


»“  era  era 


a 

q:: 

8 

«  1 


lb 

o 


lb 

<s> 


§ 


era  (o  eM  <0  in 

^  ^  ?:  a  ^ 


era  K  o 


B 


X0  o  o  in  <p 

i  in  «  tfj 


o  n  to  r-  o 

<M  ^  £5  ♦- 

^  era 


?  8  ^  a 

«  <n  CD  ^ 


O  00  o  (DO  ^  o 


<M  t-  T- 


s  ^  s  s 


«l  SS  IS  SS 


°« 


^  eno  Qo  1^0  win 


°  s 


°  § 


o  1^ 


'T  era  o  'T 
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Table  A-18;  Desert  Scene  4-Band  SCR  Analysis 


CN  O  00 
00  IT)  1—1  40 

0  0^0 
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Table  A'19:  Panel  Scene  2'Band  Results 

pf/eiasi  Miv  en9/p1/eias1  tiiv  med^pl/eiasl  fabc/pl/eiasi 


I  M 

119  119 

tdiv  orfg/p1/cfas2  tdrv  mod/p1/ctas2 

94  94 

63  119 

tdrv  ong/p2/cIas2  tdrv  mocl^p2/c(as2 


1  49 

3  54 

7  63 

42  94 

45  119 


p2^la92 

1  46 

2  94 

3  60 

4  62 

42  94 


42 

54 

tdiv  ens/p2/is 

4 

42 

tdiv  orig/pl/lg 

93 

64 

SbfJfTt/pl 

93 

64 

presc/dasl 

42 

64 


54 

60 

tdivmed/p24s 

92 
64 

tdtv/pl/lg 

93 
64 

sWJfrt/p2 

9G 

64 

presc/tg 

94 
64 


42 

119 


fi5bs/pt/das2 

42 

119 


f$bs/p2/clas2 

42 

54 

hbsfp2^ 

4 

42 

fsbs/plAg 


42 


pfesc/d3s2 

42 

64 


A-28 


Table  A'20:  Panel  Scene  2-Band  Gaussian  Maximum 
Likelihood  Confusion  Matrices 


42 

Paved  Wheat  Manmade  Dirt  Ppnd  HeaKhy  So^  Total 
Road  StructuresRoad  Pasture  Pasture 


Paved 

Road 

S3 

G 

G 

0 

G 

G 

G 

$3 

Wheat 

0 

84 

0 

0 

0 

28 

0 

112 

Manmade  Stmctures 

0 

0 

57 

1 

0 

0 

0 

58 

Did 

Road 

0 

0 

G 

3S 

G 

G 

G 

33 

Pond 

0 

0 

0 

0 

32 

0 

0 

32 

Heamiy 

Pasture 

0 

89 

0 

0 

0 

122 

39 

250 

Soggy 

Pasture 

0 

IS 

G 

G 

G 

S7 

162 

234 

Total 

53 

188 

57 

36 

32 

207 

201 

70.41 

RANK 

2 

1  119 

Paved 

Wheat  1 

Manmade  Dirt 

Pond 

Healthy  : 

Soggy  Total 

Road 

StructuresRoad 

Pasture  Pasture 

Paved 

Road 

S3 

G 

2 

G 

0 

G 

G 

S5 

Wheat 

0 

101 

0 

0 

0 

25 

21 

147 

Manmade  Structures 

0 

0 

S5 

0 

0 

0 

0 

55 

Did 

Road 

G 

0 

0 

3S 

0 

G 

3 

38 

Pond 

0 

0 

0 

0 

32 

0 

0 

32 

Healthy 

Pasture 

0 

64 

0 

0 

0 

125 

36 

225 

Soggy 

Pasture 

0 

23 

G 

1 

G 

S7 

141 

222 

Total 

53 

188 

57 

36 

32 

207 

201 

70.03 

2 


42  W 

Paved  Wheat  Manmade  Dirt  Pond  Healthy  Soggy  Total 
Road  StructuresRoad  Pasture  Pasture 


Paved 

Road 

S3 

G 

G 

0 

G 

G 

0 

S3 

Wheat 

0 

84 

0 

0 

0 

28 

0 

112 

Manmade  Structures 

0 

0 

57 

1 

0 

0 

0 

58 

Dirt 

Road 

G 

G 

G 

35 

G 

0 

G 

33 

Pond 

0 

0 

0 

0 

32 

0 

0 

32 

Healthy 

Pasture 

0 

89 

0 

0 

0 

122 

39 

250 

Soggy 

Pasture 

G 

IS 

G 

0 

0 

57 

162 

234 

Total 

53 

188 

57 

36 

32 

207 

201 

70.41 

2 


S2  U 


Paved 

Wheat  1 

Manmade  Dirt 

Pond 

Healthy 

Soggy 

Total 

Paved 

Road 

Road 

43 

G 

StructuresRoad 

0 

G 

1 

Pasture  I 

36 

Pasture 

0 

80 

Wheat 

0 

130 

4 

0 

0 

0 

20 

154 

Manmade  Structures 

0 

14 

44 

0 

0 

13 

4 

75 

Dirt 

Road 

0 

S 

0 

2G 

4 

20 

29 

78 

Pood 

0 

1 

0 

3 

27 

1 

34 

66 

Healthy 

Pasture 

10 

8 

1 

11 

0 

115 

0 

145 

Seggy 

f^tsture 

G 

30 

8 

2 

G 

22 

114 

176 

Total 

53 

188 

57 

36 

32 

207 

201 

63.70 

1 
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7  42 

paved  Wheat  Manmade  Dirt  Pond  Heathy  Soggy  Total 
Road  StructuresRoad  Pasfiae  Pasture 


Paved 

Rood 

S3 

0 

0 

0 

0 

0 

0 

S3 

Wheat 

0 

80 

0 

0 

0 

27 

1 

108 

Manmade  Structures 

0 

0 

48 

0 

6 

0 

0 

54 

Dtrt 

Road 

0 

0 

0 

33 

0 

0 

0 

33 

Pond 

0 

2 

9 

3 

26 

0 

1 

41 

Healthy 

Pasture 

0 

96 

0 

0 

0 

141 

52 

289 

Soggy 

Pasture 

0 

to 

0 

0 

0 

30 

147 

193 

Total 

53 

188 

57 

36 

32 

207 

201 

68.22 

1 

54  53 

Paved 

Wheat 

Manmade  Dirt 

Pond 

Healthy 

Soggy 

Total 

Road 

StructuresRoad 

Pasture 

Pasture 

Paved 

Road 

SO 

0 

C 

0 

0 

0 

0 

SO 

Wheat 

0 

134 

0 

0 

0 

0 

24 

158 

Manmade  Structures 

2 

0 

57 

0 

0 

0 

0 

59 

Dirt 

Road 

6 

0 

6 

30 

t 

0 

1 

32 

Pond 

1 

0 

0 

5 

31 

0 

0 

37 

Healthy 

Pasture 

0 

2 

0 

0 

0 

154 

60 

216 

Soggy 

Pasture 

0 

S2 

0 

t 

0 

$3 

113 

222 

Total 

53 

188 

57 

36 

32 

207 

201 

73.90 

2 

42  54 

Paved 

Wheat 

Manmade  Dirt 

Pond 

Healthy 

Soggy 

Total 

Road 

StructuresRoad 

Pasture  i 

Pasture 

Paved 

Road 

S3 

0 

6 

0 

0 

0 

0 

53 

Wheat 

0 

131 

0 

0 

0 

0 

22 

153 

Mannftade  Structures 

0 

0 

55 

1 

2 

0 

1 

59 

Dirt 

Road 

0 

0 

0 

34 

0 

0 

0 

34 

Pond 

0 

0 

2 

1 

30 

0 

0 

33 

Healthy 

Pasture 

0 

0 

0 

0 

0 

149 

49 

198 

Soggy 

Pasture 

0 

57 

0 

0 

0 

S3 

120 

244 

Ttrfal 

53 

188 

57 

36 

32 

207 

201 

75.06 

3 


S4  SQ 

Paved  Wheat  Manmade  Dirt  Pond  Healthy  Sog^  Total 
Road  StructuresRoad  Pasture  Pasture 


Paved 

Read 

53 

0 

0 

0 

0 

0 

0 

53 

Wheat 

0 

133 

0 

0 

0 

0 

22 

155 

Manmade  Structures 

0 

0 

57 

0 

0 

0 

0 

57 

Dirt 

Read 

0 

0 

0 

34 

0 

0 

0 

34 

Pood 

0 

0 

0 

2 

32 

0 

2 

36 

Healthy 

Pasture 

0 

1 

0 

0 

0 

156 

63 

220 

Saggy 

Pasture 

0 

54 

0 

0 

0 

SI 

114 

210 

Total 

53 

188 

57 

36 

32 

207 

201 

74.81 

3 
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42  64 

Paved  Wheat  Manmade  Dirt  Pond  Healthy  Soggy  Total 
Road  StructuresRoad  Pasture  Pasture 


Paved 

Road 

52 

0 

0 

0 

5 

0 

0 

57 

Wheat 

0 

137 

0 

0 

0 

0 

22 

159 

Manmade  Structures 

0 

0 

57 

0 

0 

0 

0 

57 

Dirt 

Road 

1 

0 

0 

34 

0 

0 

0 

35 

Pond 

0 

0 

0 

1 

27 

0 

0 

28 

Healthy 

Pasture 

0 

3 

0 

0 

0 

171 

58 

232 

Soggy 

Pasture 

0 

48 

0 

1 

0 

36 

121 

206 

Total 

53 

188 

57 

36 

32 

207 

201 

77^ 

3 


60  64 

Paved  Wheat  Manmade  Dirt  Pond  Healthy  Soggy  Total 
Road  StructuresRoad  Pasture  Pasture 


Paved 

Road 

53 

0 

0 

0 

0 

0 

0 

53 

Wheat 

0 

143 

0 

0 

0 

4 

24 

171 

Manmade  Structures 

0 

0 

44 

3 

0 

0 

4 

51 

Dirt 

Road 

0 

0 

4  ’ 

30 

0 

0 

0 

34 

Pond 

0 

0 

0 

0 

32 

0 

0 

32 

Healthy 

Pasture 

0 

3 

0 

3 

0 

185 

24 

215 

Soggy 

Pasture 

0 

42 

9 

0 

0 

18 

149 

218 

Total 

53 

188 

57 

36 

32 

207  ■ 

201 

82.17 

3 


54  60 

Paved  Wheat  Manmade  Dirt  Pond  Healthy  Soggy  Total 
Road  StructuresRoad  Pasture  Pasture 


Paved 

Road 

53 

0 

0 

0 

0 

0 

0 

53 

Wheat 

0 

133 

0 

0 

0 

0 

22 

155 

Manmade  Structures 

0 

0 

57 

0 

0 

0 

0 

57 

Dirt 

Road 

0 

0 

0 

34 

0 

0 

0 

34 

Pond 

0 

0 

0 

2 

32 

0 

2 

36 

Healthy 

Pasture 

0 

1 

0 

0 

0 

156 

63 

220 

Soggy 

Pasture 

0 

54 

0 

0 

0 

51 

114 

219 

Total 

53 

188 

57 

36 

32 

207 

201 

74.81 

3 


4  42 

Paved  Wheat  Manmade  Dirt  Pond  Healthy  Soggy  Total 
Road  StructuresRoad  Pasture  Pasture 


Paved 

Road 

53 

0 

0 

0 

0 

0 

0 

53 

Wheat 

0 

84 

0 

0 

0 

51 

7 

142 

Manmade  Structures 

0 

0 

54 

0 

9 

0 

0 

63 

Dirt 

Road 

0 

0 

0 

30 

0 

0 

0 

30 

Pond 

0 

0 

3 

6 

23 

0 

1 

33 

Healthy 

Pasture 

0 

99 

0 

0 

0 

132 

65 

296 

Soggy 

Pasture 

0 

5 

0 

0 

0 

24 

128 

157 

Total 

53 

188 

57 

36 

32 

207 

201 

65.12 

1 
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62  64 

Paved  Wheat 

Road 

Manmade  Dirt 

Structures  Road 

Pond 

Healthy 

Pasture 

Soggy 

Pasture 

Total 

Paved 

Road 

40 

0 

0 

2 

0 

52 

0 

94 

Wheat 

0 

130 

0 

0 

0 

0 

15 

145 

Manmade  Structures 

0 

8 

57 

0 

0 

41 

0 

106 

Dift 

Road 

0 

4 

0 

16 

3 

15 

12 

SO 

Pond 

0 

11 

0 

13 

16 

23 

28 

91 

Healthy 

Pasture 

13 

0 

0 

4 

9 

68 

0 

94 

Soggy 

Pasture 

0 

35 

0 

1 

4 

8 

146 

194 

Total 

53  188 

54  64 

Paved  Wheat  1 

Road 

57 

Manmade  Dirt 

Structures  Road 

36 

Pond 

32 

207 

Healthy 

Pasture 

201 

Soggy 

Pasture 

61.11 

1 

Total 

Paved 

Road 

52 

0 

0 

0 

0 

0 

0 

52 

Wheat 

0 

133 

0 

0 

0 

5 

25 

163 

Manmade  Structures 

0 

0 

57 

0 

0 

0 

0 

57 

Dirt 

Road 

0 

0 

0 

34 

0 

0 

1 

35 

Pond  ' 

1 

0 

0 

1 

32 

0 

0 

34 

Healthy 

Pasture 

0 

0 

0 

0 

0 

161 

55 

216 

Soggy 

Pasture 

0 

55 

0 

1 

0 

41 

120 

217 

Total 

53 

188 

57 

36 

32 

207 

201 

76.10 

3 

Mean:  71.66 

Std:  5.81 

Mean  +  !4  std:  74.55 

Mean  -  Vz  std:  68.77 
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Table  A-21:  Panel  Scene  2-Band  SCR/LOG  Stimuli/Response 
Matrices 


64 

110 

1 

119 

42 

119 

63 

64 

7 

42 

54 

63 

42 

54 

0.25 

0.25 

025 

0.25 

0.25 

025’ 

025 

0 

26 

0 

26 

0 

26 

0 

26 

0 

26 

0 

26 

0 

26 

0 

732 

0 

732 

0 

732 

0 

732 

0 

732 

0 

732 

0 

732 

0.08 

0.08 

0.08 

0.08 

0.08 

0.08 

0.06 

0 

26 

0 

26 

26 

0 

0 

26 

0 

26 

0 

26 

0 

26 

3 

729 

47 

685 

732 

0 

0 

732 

0 

732 

2 

730 

0 

732 

0.05 

0.05 

0.05 

0.05 

0.05 

0.05 

0.05 

26 

0 

26 

0 

26 

0 

0 

26 

67 

665 

26 

0 

0 

26 

730 

2 

732 

0 

656 

76 

0 

732 

3.43 

0 

730 

2 

67 

665 

005 

0.05 

0.05 

0.05 

0.05 

0.05 

0X15 

26 

0 

26 

0 

26 

0 

26 

0 

26 

0 

26 

0 

26 

0 

0 

732 

1 

731 

0 

732 

7 

725 

1 

731 

0 

732 

0 

732 

0.1 

0.1 

0.1 

0.1 

0.1 

0.1 

0.1 

26 

0 

26 

0 

26 

0 

26 

0 

26 

0 

26 

0 

26 

0 

0 

732 

1 

731 

0 

732 

7 

725 

1 

731 

0 

732 

0 

732 

025 

025 

025 

025 

025 

025 

025 

26 

0 

26 

0 

26 

0 

26 

0 

26 

0 

26 

0 

26 

0 

0 

732 

1 

731 

0 

732 

5 

727 

1 

731 

0 

732 

0 

732 

42 

64 

60 

64 

54 

60 

4 

42 

62 

64 

54 

64 

54 

60 

025 

0.25 

025 

0.25 

0.25 

025 

025 

0 

26 

0 

26 

0 

26 

0 

26 

0 

26 

0 

26 

0 

26 

0 

732 

0 

732 

0 

732 

0 

732 

0 

732 

0 

732 

0 

732 

0.08 

0.08 

0.08 

0.08 

0.08 

0.08 

0.06 

0 

26 

0 

26 

0 

26 

0 

26 

0 

26 

0 

26 

26 

0 

3 

729 

208 

524 

0 

732 

0 

732 

0 

732 

0 

732 

732 

0 

0.05 

0.05 

0.05 

0.05 

0.05 

0.05 

0.05 

0 

26 

0 

26 

0 

26 

0 

26 

0 

26 

0 

26 

26 

0 

66 

666 

508 

228 

1 

731 

0 

732 

1 

731 

96 

636 

728 

4 

0.05 

0-05 

0.05 

0.05 

0.05 

0.05 

0.05 

26 

0 

26 

0 

26 

0 

26 

0 

26 

0 

26 

0 

26 

0 

0 

732 

0 

732 

0 

732 

0. 

732 

0 

732 

0 

732 

0 

732 

0.1 

0.1 

0.1 

0.1 

0.1 

0.1 

0.1 

26 

0 

26 

0 

26 

0 

26 

0 

26 

0 

26 

0 

26 

0 

0 

732 

0 

732 

0 

732 

0 

732 

0 

732 

0 

732 

0 

732 

0.25 

025 

025 

025 

0.25 

025 

025 

26 

0 

26 

0 

26 

0 

26 

0 

26 

0 

26 

0 

26 

0 

0 

732 

0 

732 

0 

732 

0 

732 

0 

732 

0 

732 

0 

732 
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Table  A-22:  Panel  Scene  2-Band  SCR  Analysis 


8  8  8  8  S  8 

d  d  9  d  9  w 


8  o  $2  8  ^  8 

o  9  9  d  9  <si 
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8  8  8  8  S  ; 
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d  6  c>  - 
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888888 

d  9  d  d  d  d 
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o 

o 
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s 
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a; 

X 
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o 

M 
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§ 

o 

M 

8^88 

"  W 

d  d  ^ 

^1 
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1.00 
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60.00 

a^ 
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d  d  d 

Af 

X 

888888 

Xi 

X 
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o 
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8 

o 
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^1 
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0.00 

^JX^ 
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0.00 
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1.00 

A£ 

X 

888888 

.•tf 

X 
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O 
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8 

o 
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»i 
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8 
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8 
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f 

f 
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3 

CO 
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Table  A-23:  Panel  Scene  2-Band  LOG  Analysis 


^  8  8  §  §  §  8. 

O  <r^  ^  O  CO  CO 

8888888 
O  ir-  -r-  -t-:  d  CO  CO 

0.00 

0.00 

0.00 

0.00 

1.00 

64.00 

also 

irm 

8  8  8  8  8 
dddd'i- 

0.00 

1.00 

1.00 

1.00 

1.00 

64.00 

F 

A(£ 

8  8  8  8  8 
d  ^  ^ 

£ 

8  8  S  8  8  8  8 

O  <r-  r>  T-  d  <*>  CO 

8888888 
o  T-  ^  ^  d  CO  CO 

0.00 

0.00 

0.00 

0.00 

1.00 

64.00 

also 

irm 

8  8  8  8  8 
d  d  d  dr- 

0.00 

1.00 

1.00 

1.00 

1.00 

62.00 

F  ; 
Ala 

88  8  8  8 
d  r^  r^  r^  r^ 

!tS 

8  8  8  8  8  8  8 
d  d  CO  cvl 

§  8  8  8  8  8  8 
d  r-  r-  ^  d  CO  CO 

0.00 

0.00 

0.00 

0.00 

1.00 

i2.00 

1  s  e 

1 

8  8  8  8  8 
d  d  d  d  r-: 

0.00 

1.00 

1.00 

1.00 

1.00 

4.00  4 

F  a 
Alam 

8  3  §  S  8. 

d  r-  1“  r-  ^ 

0.00 

0.99 

0.99 

0.99 

0.00 

2.97 

1.00 
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8888888 
d  r^  r^  d  CO  CO 

S  p  p  p  S  o  ^ 

8  8  8  8  8 

0.00  c 

1.00  c 
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F  a  I 
Alarm 

OOOOr- 
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0.00 

0.00 

0.00 

0.00 

1.00 
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Marm 
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O  d  O  O  r-' 

8  8  8  8  8  g 
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§  ^  § 
OOOOr- 
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O  ^  Y-  ei 
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±: 

X 
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8888888 
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A-35 


Table  A-24;  Panel  Scene  4-Band  Results 


Band  Set 
pl/clasi 


1 

3 

7 

42 

45 


p2/clas2 


1 

2 

3 

4 
42 

7 

sbf/p1 

42 

46 

63 

64 


1 

tdiv 

-  ofig/pl/clas 

1 

2 

febs/pl/das 

1 

3 

tdiv 

mod/pi /clas 
1 

46 

3 

42 

1 

54 

54 

54 

7 

63 

63 

64 

64 

64 

119 

119 

119 

119 

tdiv  febs/pl/clas  tdiv 


Ofip/pl/clas 

2 

2 

mod/pi /das 
2 

3 

42 

1 

54 

54 

7 

63 

64 

64 

119 

119 

119 

4 

5 

6 

tdiv 

ong/p2/cias 

2 

f$bs/p2/das 

2 

tdiv 

mod/p2/das 

2 

46 

2 

42 

54 

54 

54 

46 

60 

60 

60 

54 

62 

62 

64 

62 

64 

64 

8 

9 

10 

11 

sb£rp2 

tdiv 

orig/pl/tg 

febs/pl/lg 

tdiv 

mcpd/p1/^ 

46 

7 

1 

45 

60 

42 

7 

46 

62 

46 

42 

54 

64 

63 

119 

64 

12 

13 

14 

tdiv 

ong/p2/lg 

f5bs/p2Ag 

tdiv 

fnod/p2/tg 

4 

1 

42 

42 

4 

46 

54 

42 

60 

62 

64 

64 
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Table  A-25:  Panel  Scene  4-Band  Gaussian  Maximum 
Likelihood  Confusion  Matrices 


1 


Pavod  Manmade  Dirt  Healthy  Soggy 

Road  Wheat  StructuresRoad  Pond  Pasture  Pasture  Total 


Paved  Road 

53 

1 

4 

0 

0 

0 

0 

58 

Wheat 

0 

173 

0 

0 

0 

0 

0 

173 

Manmade 

Structures 

0 

0 

53 

0 

0 

0 

0 

53 

Dirt  Road 

0 

0 

0 

36 

0 

0 

0 

36 

Pond 

0 

0 

0 

0 

32 

0 

0 

32 

Healthy  Pasture 

0 

0 

0 

0 

0 

158 

61 

219 

Soggy  Pasture 

0 

14 

0 

0 

0 

49 

140 

203 

Total 

53 

188 

57 

36 

32 

207 

201 

83.33 

Paved  Manmade  Dirt  H^lthy  Soggy 

Road  Wheat  StructuresRoad  Pond  Pasture  Pasture  Total 


Paved  Road 

53 

0 

5 

0 

0 

0 

0 

58 

Wheat 

0 

169 

0 

0 

0 

0 

0 

169 

Manmade 

Structures 

0 

0 

52 

0 

0 

0 

0 

52 

Dirt  Road 

0 

0 

0 

36 

0 

0 

0 

36 

Pond 

0 

0 

0 

0 

32 

0 

0 

32 

Healthy  Pasture 

0 

0 

0 

0 

0 

157 

54 

211 

Soggy  Pasture 

0 

19 

0 

0 

0 

50 

147 

216 

Total 

53 

188 

67 

36 

32 

207 

201 

8346 

3 


3 


Paved  Manmade  Dirt 

Road  Wheat  StructuresRoad  Pond 


Healthy  Soggy 
Pasture  Pasture  Total 


Paved  Road 

53 

0 

4 

0 

0 

0 

0 

57 

Wheat 

0 

150 

Q 

0 

0 

2 

11 

163 

Manmade 

Structures 

0 

0 

53 

0 

0 

0 

0 

53 

Dirt  Road 

0 

0 

0 

36 

0 

1 

1 

38 

Pond 

0 

0 

0 

0 

32 

0 

0 

32 

Healthy  Pasture 

0 

14 

0 

0 

0 

167 

42 

223 

Soggy  Pasture 

0 

24 

0 

0 

0 

37 

147 

208 

Total 

53 

188 

57 

36 

32 

207 

201 

8243 

3 


4 


Paved  Manmade  Dirt  Healthy  Soggy 

Road  Wheat  StructuresRoad  Portd  Pasture  Pasture  Total 


Paved  Road 

53 

0 

2 

1 

0 

0 

0 

56 

Wheat 

0 

153 

0 

0 

0 

12 

7 

172 

Manmade 

Structures 

0 

0 

55 

0 

0 

0 

0 

55 

Dirt  Road 

0 

0 

0 

34 

0 

0 

1 

35 

Pond 

0 

0 

0 

0 

32 

0 

0 

32 

Healthy  Pasture 

0 

0 

0 

0 

0 

163 

61 

224 

Soggy  Pasture 

0 

35 

0 

0 

0 

32 

132 

109 

Total 

53 

188 

57 

35 

32 

207 

201 

80.36 

2 

A-37 


6 


Paved  Manmade  Dirt  Healthy  Soggy 

Road  Wheat  Structures  Road  Pond  Pashire  Pasture  T otai 


Paved  Road 

53 

0 

5 

0 

0 

0 

0 

58 

Wheat 

0 

152 

0 

0 

0 

25 

7 

184 

Manmade 

Structures 

0 

0 

52 

0 

0 

0 

0 

52 

Dirt  Road 

0 

0 

0 

35 

0 

0 

1 

36 

Pond 

0 

0 

0 

0 

32 

0 

0 

32 

Healthy  Pasture 

0 

0 

0 

0 

0 

162 

50 

212 

Soggy  Pasture 

0 

36 

0 

1 

0 

20 

143 

200 

Total 

53 

188 

57 

36 

32 

207 

201 

81^ 

2 


6 

Paved  Manmade  Dirt  Healthy  Soggy 

Road  Wheat  Structures  Road  Pond  Pasture  Pasture  Total 


Paved  Road 

53 

5 

0 

1 

0 

41 

0 

100 

Wheat 

0 

128 

0 

0 

0 

8 

16 

152 

Manmade 

Structures 

0 

0 

57 

0 

0 

0 

0 

57 

Dirt  Road 

0 

0 

0 

34 

0 

0 

1 

35 

Pond 

0 

0 

0 

0 

32 

0 

0 

32 

Healthy  Pasture 

0 

3 

0 

0 

0 

141 

57 

201 

Soggy  Pasture 

0 

52 

0 

1 

0 

17 

127 

197 

Total 

53 

188 

57 

36 

32 

207 

201 

7330 

1 


7 

Paved  Manmade  Dirt  Healthy  Soggy 

Road  Wheat  Structures  Road  Pond  Pasture  Pasture  Total 


Paved  Road 

53 

2 

1 

0 

1 

21 

0 

78 

Wheat 

0 

134 

0 

0 

0 

9 

20 

163 

Manmade 

Struchrres 

0 

0 

56 

1 

0 

0 

0 

57 

Dirt  Road 

0 

0 

0 

34 

0 

0 

1 

35 

Pond 

0 

0 

0 

0 

31 

0 

0 

31 

Healthy  Pasture 

0 

5 

0 

0 

0 

153 

29 

187 

Soggy  Pasture 

0 

47 

0 

1 

0 

24 

151 

223 

Total 

53 

188 

57 

36 

32 

207 

201 

79.07 

2 

8 

Paved 

Manmade  Dirt 

Healthy 

Soggy 

Road  Wheat  i 

Structures  Road 

Pond 

Pasture  I 

Pasture  Total 

Paved  Road 

53 

6 

0 

1 

0 

40 

0 

99 

Wheat 

0 

139 

0 

0 

0 

7 

18 

164 

Manmade 

Structures 

0 

0 

57 

0 

0 

0 

0 

57 

Dirt  Road 

0 

0 

0 

34 

0 

0 

0 

34 

Pond 

0 

0 

0 

0 

32 

0 

0 

32 

Healthy  Pasture 

0 

4 

0 

0 

0 

146 

60 

210 

Soggy  Pasture 

0 

40 

0 

1 

0 

14 

123 

178 

Total 

53 

188 

57 

36 

32 

207 

201 

7BA$ 

1 
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9 


Paved 

Manmade  Dirt 

Healthy 

Soggy 

Road 

Wheat 

Structures  Road 

Pond 

Pasture 

Pasture 

Total 

Paved  Road 

53 

0 

1 

0 

1 

0 

0 

55 

Wheat 

0 

162 

0  " 

0 

0 

2 

4 

168 

Manmade 

Structures 

0 

0 

56 

1 

0 

0 

0 

57 

Dirt  Road 

0 

0 

0 

34 

0 

0 

0 

34 

Pof)d 

0 

0 

0 

0 

31 

0 

0 

31 

Heatthy  Pasture 

0 

4 

0 

0 

0 

157 

48 

209 

Soggy  Pasture 

0 

22 

0 

1 

0 

48 

149 

220 

Total 

53 

188 

57 

36 

32 

207 

201 

82.95 

3 

10 

Paved 

Manmade  Dirt 

Healthy 

Soggy 

Road  ’ 

Wheat 

Structures  Road 

Pond 

Pasture 

Pasture 

Total 

Paved  Road 

53 

0 

4 

0 

0 

0 

0 

57 

Wheat 

0 

72 

0 

0 

0 

21 

1 

94 

Manmade 

Structures 

0 

0 

53 

0 

0 

0 

0 

63 

Dirt  Road 

0 

0 

0 

36 

0 

0 

0 

36 

Pond 

0 

0 

0 

0 

32 

0 

0 

32 

Heafthy  Pasture 

0 

100 

0 

0 

0 

127 

42 

269 

Soggy  Pasture 

0 

16 

0 

0 

0 

59 

158 

233 

Total 

53 

188 

67 

36 

32 

207 

201 

68.60 

1 

11 

Paved 

Manmade  Dirt 

Heatthy 

Soggy 

Road  Wheat 

Structures  Road 

Pond 

Pasture 

Pasture 

Total 

Paved  Road 

53 

0 

0 

0 

0 

0 

0 

53 

Wheat 

0 

154 

0 

0 

0 

16 

26 

196 

Manmade 

Structures 

0 

0 

57 

0 

0 

0 

0 

57 

Dirt  Road 

0 

0 

0 

35 

0 

0 

1 

36 

Pond 

0 

0 

0 

0 

32 

0 

0 

32 

Heatthy  Pasture 

0 

1 

0 

0 

0 

159 

54 

214 

Soggy  Pasture 

0 

33 

0 

1 

0 

32 

120 

186 

Total 

53 

188 

57 

36 

32 

207 

201 

78.81 

0 

12 

Paved 

Manmade  Dirt 

Healthy 

Soggy 

Road  Wheat 

Structures  Road 

Pond 

Pasture  1 

Pasture 

Total 

Paved  Road 

63 

0 

0 

0 

0 

0 

0 

53 

Wheat 

0 

169 

0 

0 

0 

10 

5 

184 

Manmade 

Structures 

0 

0 

57 

0 

0 

0 

0 

57 

Dirt  Road 

0 

0 

0 

35 

0 

0 

1 

36 

Pond 

0 

0 

0 

0 

32 

0 

0 

32 

Heatthy  Pasture 

0 

0 

0 

0 

0 

166 

45 

211 

Soggy  Pasture 

0 

19 

0 

1 

0 

31 

150 

201 

Total 

53 

188 

57 

36 

32 

207 

201 

85.53 

3 
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13 


Paved  Manmade  Did  Healthy  Soggy 

Road  Wheat  Structures  Road  Pond  Pasture  Pasture  Total 


Paved  Road 

53 

1 

5 

0 

0 

11 

0 

70 

Wheat 

0 

162 

0 

0 

0 

10 

2 

174 

Manmade 

Structures 

0 

0 

52 

0 

0 

0 

0 

52 

CMrtRoad 

0 

0 

0 

36 

0 

0 

0 

36 

PorxJ 

0 

0 

0 

0 

32 

0 

0 

32 

Healthy  Pasture 

0 

7 

0 

0 

0 

177 

54 

238 

Soggy  Pasture 

0 

18 

0 

0 

0 

9 

145 

172 

Total 

53 

188 

57 

36 

32 

207 

201 

84.88 

3 


14 

Paved  Manmade  Dirt  Healthy  Soggy 

Road  Wheat  Structures  Road  PotkI  Pasture  Pasture  Total 


Paved  Road 

53 

0 

0 

0 

1 

0 

0 

54 

Wheat 

0 

137 

0 

0 

0 

17 

16 

170 

Manmade 

Structures 

0 

0 

57 

0 

0 

0 

0 

57 

Dirt  Road* 

0 

0 

0 

35 

0 

0 

1 

36 

Pond 

0 

0 

0 

0 

31 

0 

0 

31 

Healthy  Pasture 

0 

1 

0 

0 

0 

163 

55 

219 

Soggy  Pasture 

0 

50 

0 

1 

0 

27 

129 

207 

Total 

53 

188 

57 

36 

32 

207 

201 

78.17 

2 


16 

Paved  Manmade  Dirt  Healthy  Soggy 

Road  Wheat  Structures  Road  Pond  Pasture  Pasture  Total 


Paved  Road 

52 

0 

0 

0 

0 

0 

0 

52 

Wheat 

0 

135 

0 

0 

0 

4 

25 

164 

Manmade 

Structures 

0 

0 

57 

0 

0 

0 

0 

57 

Dirt  Road 

1 

0 

0 

35 

0 

0 

1 

37 

Pond 

0 

0 

0 

0 

32 

0 

0 

32 

Healthy  Pasture 

0 

2 

0 

0 

0 

175 

47 

224 

Soggy  Pasture 

0 

51 

0 

1 

0 

28 

128 

208 

Total 

53 

188 

57 

36 

32 

207 

201 

79.33 

2 

Mean: 

79.87 

Std: 

4.70 

Mean  +  V2  std: 

82.22 

Mean  -  ‘A  std: 

77.52 
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Table  A-26:  Panel  Scene  4-Band  SCR/LOG  Stimuli/Response 
Matrices 

1  2  3  4  5  6  7 

SCR 

0.26 


0  26  0  26  0  26  0 


0 

732 

0 

732 

0 

732 

0 

0.005 

26 

0 

0 

26 

0 

26 

25 

505 

227 

2 

730 

2 

730 

338 

0.001 

26 

0 

26 

0 

26 

0 

26 

730 

2 

730 

2 

77 

655 

732 

LOG  * 

0.05 

26 

0 

26 

0 

26 

0 

26 

0 

732 

0 

732 

0 

732 

0 

8 

9 

10 

11 

0 

26 

0 

26 

0 

26 

0 

0 

732 

0 

732 

0 

732 

0 

0 

26 

26 

0 

0 

26 

0 

144 

588 

732 

0 

3 

729 

0 

26 

0 

0 

26 

26 

0 

0 

729 

3 

54 

678 

64 

668 

0 

26 

0 

26 

0 

26 

0 

26 

0 

732 

0 

732 

0 

732 

0 

26  0  26  0  26  0  26 


732 

0 

732 

0 

732 

0 

732 

1 

0 

26 

0 

26 

0 

26 

394 

0 

732 

280 

452 

0 

732 

0 

0 

26 

26 

0 

0 

26 

0 

16 

716 

729 

3 

32 

700 

0 

26 

0 

26 

0 

26- 

0 

732 

0 

732 

0 

732 

0 

732 

12 

13 

14 

26 

0 

26 

0 

26 

0 

26 

732 

0 

732 

0 

732 

0 

732 

26 

0 

26 

26 

0 

0 

26 

732 

0 

732 

93 

639 

0 

732 

26 

0 

26 

26 

0 

0 

26 

732 

102 

630 

715 

17 

106 

626 

0 

26 

0 

26 

0 

26 

0 

732 

0 

732 

0 

732 

0 

732 
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Table  A-27;  Panel  Scene  4-Band  SCR  Analysis 


^  S  S  8  S  8 

o  d  9  d  9  w 


8  8  ?  8  ?  8 

d  d  9  d  9  1-: 


§  8  S  8 

o  d  d  1-^ 


8  8  ?  8 
d  d  d 


8  8  8  8  8 
d  d  d  -V 


8  8  88 

o  d  o  T-' 


888888 

o  9  d  d  9 


8  8  8  8  8 

o  d  d  d  d  d 


;g 

ll  < 


8  8  8  8 
d  d 


8  8  8  ^8  8 


O  O  -t-  ▼- 


8  52  8  8 

d  d  d 


8  8  8  8 
O  ^ 


8  8  S  8  S  8 

o  o  9  d  9  d 


8  8  ?  8  ?  8 
d  d  9  d  9 


8  8  8  8 
d  d  d  ^ 


8  8^8 

d  d  d  W 


8  8  8  8 
o  d  d 


8  8  8  8 

d  d  d  T>' 


888888 

o  d  d  d  d  d 


888888 

o  d  d  d  d  rsi 


8  8 
d  d 


8  8  8  8 
d  d  d 


ii.< 


8  8  8 
d  d  Y-: 


11.5 


8  8  8  8 

d  d  d  Y- 


888888 

d  9  d  d  d  d 


8  8  o  8  S  8 
o  9  d  d  d  d 


8  8  8 

d  d  d  Y-' 


8  8  8  8 

d  d  d  Y-’ 


8  8  8  8  8 

d  d  Y-^  Y-'  d 


8  8  8  8 

d  d  Y^  Y-: 


8  8  8  S  8  8 

d  9  d  d  d  CM 


§  g  8  8  &  8 

o  cj)  d  d  Y-^ 


“  E 

z< 


8  8  8  8 
d  d  Y-:  Y-: 


8  8  8  8  8 

d  d  Y-'  Y-“ 


11.5 


8^8 

d  o  Y-: 


8  8  8 

d  d  Y^ 


8  CO  8  8  5>  8 
d  d  d  d  d  ci 


888828 

o  9  d  d  9  CO 


8  8  8  8 

d  d  Y-;  Y^ 


8  8  8  8 

O  O  Y^  Y^ 


8  8  8  8  8 

d  Y-  Y-  Y-  ed 


8  8  8  8 

d  d  Y-:  Y-: 


SO  m  OO 

^  rn 
o  o  o 


o 

o 

I 


+  1 

I  ..  §  § 

a>  0)  (U 
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Table  A-28;  Pasture  Scene  4-Band  Results 


pi /das 

1 

tdiv 

orig/pl/das 

1 

tdiv 

mod/pi /das 

1 

febs/pl/das 

1 

1 

57 

71 

71 

55 

2 

61 

84 

84 

84 

3 

62 

4 

63 

5 

64 

8 

65 

tdiv 

orig/pl/das 

2 

tdiv 

mod/pi /das 

2 

fsbs/pl/das 

2 

37 

66 

53 

70 

57 

57 

55 

54 

71 

61 

61 

84 

55 

84 

p2/das 

2 

tdiv 

orig/p2/das 

2 

tdiv 

mod/p2/das 

2 

f5bs/p2/das 

2 

1 

57 

57 

57 

61 

3 

61 

61 

61 

83 

53 

62 

54 

63 

55 

83 

tdiv 

orig/p2/lg 

tdiv 

mod/p2/tg 

fsbs/p2/tg 

pi  a/da 
si 

63 

63 

62 

83 

83 

83 

54 

55 

61 

62 

71 

tdiv 

orig/p1/tg 

tdiv/pl/tg 

febs/pl/lg 

66 

66 

62 

70 

70 

84 

sbfjnt/pl 

sbfjrrt/pla 

sbfjnt/p2 

53 

61 

S3 

54 

71 

54 

presc/clasi 

presc/tg 

presc/das2 

54 

54 

54 

71 

64 

83 

tdiv 

febs/p1a/da 

tdiv 

orig/pl  a/da 
si 

si 

fnod/p1a/cla 

si 
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Table  A-29:  Pasture  Scene  2-Band 
Gaussian  Likelihood  Confusion  Matrices 

7184 


pasture  water  unknown  wh^il  wheat2  total 


pasture 

233 

0 

0 

9 

9 

251 

water 

0 

60 

0 

0 

0 

60 

unknown 

1 

0 

98 

0 

0 

99 

wheatl 

1 

0 

0 

233 

12 

246 

wheat2 

0 

0 

0 

45 

85 

130 

tot^ 

235 

60 

96 

287 

106 

90^ 

pasture  water  unknown  wheatl  wheat2  total 


pasture 

232 

0 

0 

9 

0 

241 

water 

0 

59 

0 

0 

0 

59 

urtknown 

2 

0 

98 

0 

0 

100 

wheatl 

1 

0 

0 

276 

0 

277 

wheat2 

0 

1 

0 

2 

106 

109 

total 

235 

60 

98 

287 

106 

98J03 

pasture  water  unknown  wheatl  wheat2  total 


pasture 

235 

0 

0 

7 

10 

252 

water 

0 

60 

0 

0 

0 

60 

unknown 

0 

0 

98 

0 

0 

S8 

wheatl 

0 

0 

0 

202 

8 

210 

wheat2 

0 

0 

0 

78 

88 

166 

total 

235 

60 

98 

287 

106 

86^ 

pasture  water  unknown  wheatl  wheat2  total 


pasture 

207 

0 

0 

14 

3 

224 

water 

0 

60 

0 

0 

0 

60 

unknown 

27 

0 

98 

0 

0 

125 

wheatl 

0 

0 

0 

215 

51 

266 

wheat2 

0 

0 

0 

58 

52 

110 

tot^ 

234 

60 

98 

287 

106 

80A1 

1 
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67  61 


pasture  water 

unknown 

wheatl 

wheats  i 

total 

pasture 

227 

0 

2 

10 

0 

239 

water 

0 

55 

0 

0 

10 

65 

unknown 

0 

0 

93 

0 

0 

93 

wheatl 

0 

1 

3 

277 

8 

289 

wheat2 

8 

4 

0 

0 

96 

108 

total 

235 

60 

98 

287 

114 

95.17 

3 

61  83 

pasture  water 

unknown 

wheatl 

wheats  total 

pasture 

234 

0 

0 

10 

12 

256 

water 

0 

60 

0 

0 

0 

60 

unknown 

0 

0 

98 

0 

0 

98 

wheatl 

1 

0 

0 

194 

11 

206 

wheats 

0 

0 

0 

83 

83 

166 

total 

235 

60 

98 

287 

’  106 

85.11 

4 

63  83 

1 

pasture  water 

unknown  ' 

wheatl  ' 

wheats  total 

(Kksture 

233 

0 

0 

8 

11 

252 

water 

0 

60 

0 

0 

0 

60 

unknown 

0 

0 

98 

0 

0 

98 

wheatl 

2 

0 

0 

197 

6 

205 

wheats 

0 

0 

0 

82 

89 

171 

total 

235 

60 

98 

287 

106 

86.13 

4 

62  83 

1 

pasture  water 

unknown  ' 

wheatl  wheat2  total 

pasture 

233 

0 

0 

7 

8 

248 

water 

0 

60 

0 

0 

0 

60 

unknown 

0 

0 

98 

0 

0 

98 

wheatl 

2 

0 

0 

226 

30 

258 

wheats 

0 

0 

0 

54 

68 

122 

total 

235 

60 

98 

287 

106 

87.15 

2 

Mean: 

89.76 

Std: 

6.51 

Mean  +  Vi  std: 

93.02 

Mean  -  ‘A  std: 

86.51 
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64 


71 


pasture  water  unknown  wheatl  wheat2  total 


pasture 

230 

0 

2 

7 

0 

239 

water 

0 

56 

0 

0 

0 

56 

unknown 

0 

0 

94 

0 

0 

94 

wheatl 

5 

0 

2 

280 

0 

287 

wheat2 

0 

4 

0 

0 

106 

110 

total 

235 

60 

98 

287 

106 

97.46 

3 

54 

83 

pasture  water 

unknown  wheatl  wheat2  1 

total 

pasture 

232 

0 

1 

8 

0 

241 

water 

0 

59 

0 

0 

0 

59 

unknown 

1 

0 

97 

0 

0 

98 

wheatl 

2 

0 

0 

277 

0 

279 

wheat2 

0 

1 

0 

2 

106 

109 

total 

235 

60 

98 

287 

106 

98.09 

3 

61 

71 

pasture  water 

unknown  wheatl  wheat2  total 

pasture 

232 

0 

0 

6 

11 

249 

water 

0 

60 

0 

0 

0 

60 

unknown 

3 

0 

98 

0 

0 

101 

wheatl 

0 

0 

0 

244 

19 

263 

wheat2 

0 

0 

0 

37 

76 

113 

total 

235 

60 

98 

287 

106 

90.33 

2 

63 

54 

pasture  water 

unknown  wheatl  wheat2  t 

otal 

pasture 

186 

0 

0 

47 

0 

233 

water 

3 

52 

8 

1 

19 

83 

unknown 

0 

3 

90 

0 

0 

93 

wheatl 

43 

5 

0 

205 

4 

257 

wheat2 

3 

0 

0 

34 

83 

120 

total 

235 

60 

98 

287 

106 

78.37 

4 

54 

64 

1 

pasture  water 

unknown  wheatl  wheat2  total 

pasture 

225 

0 

2 

9 

0 

236 

water 

0 

53 

0 

0 

20 

73 
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Table  A-30:  Pasture  Scene  2-Band  SCR/LOG  Stimuli/Response  Matrices 
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Table  A-31:  Pasture  Scene  2-Band  SCR  Analysis 
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Table  A-32:  Pasture  Scene  2-Band  LOG  Analysis 
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Table  A-33:  Pasture  Scene  4-Band  Results 
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Table  A-34:  Pasture  Scene  4-Band  Gaussian 
Maximum  Likelihood  Confusion  Matrices 
1 

pasture  water  unknown  wheatl  whea(t2  total 
pasture  235  0  6  18  0  259 

water  0  60  0  0  0  60 

unknown  0  0  92  0  0  92 

wheatl  0  0  0  289  0  289 

wheat2  0  0  0  45  106  151 

total  235  60  98  332  106  96.95 


pasture  water  unknown  wheatl  wheat2  total 
pasture  235  0  6  9  2  252 

water  0  60  0  0  0  60 

unknown  0  0  92  '  0  0  92 

wheatl  0  0  0  278  3  281 

wheat2  0  0  0  45  101  146 

total  235  60  98  332  106  97.46 


pasture  water  unknown  wheatl  wheat2  total 
pasture  235  0  6  9  3  253 

water  0  60  0  0  0  60 

unknown  0  0  92  0  0  92 

wheatl  0  0  0  278  2  280 

wheat2  0  0  0  0  101  101 

total  235  60  98  287  106  9746 


pasture  water  unknown  wheatl  v4)eat2  total 
pasture  229  0  5  15  2  251 

water  0  59  0  0  0  59 

unknown  0  0  93  0  0  93 

wheatl  6  1  0  272  5  284 

wheat2  0  0  0  45  99  144 

total  235  60  98  332  106  96.67 


pasture  water  unknown  wheatl  wheat2  total 
pasture  233  0  2  15  2  252 

water  0  59  0  0  0  59 

unknown  1  0  96  0  0  97 

wheatl  1  1  0  271  7  280 

wheat2  0  0  0  1  97  98 

total  235  60  98  287  106  96.18 
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Mean: 
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Std: 
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Table  A-35:  Pasture  Scene  4-Band  SCR/LOG  Stimuli/Response  Matrices 
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Table  A-36;  Pasture  Scene  4-Band  SCR  Analysis 
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Table  A-37:  Pasture  Scene  4-Band  LOG  Analysis 
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Appendix  B 

;  IDL  COVARIANCE  FUNCTION  - 1  Laurenzano  (1997) 

;  This  function  was  designed  specifically  to 
;  develop  a  covariance  matrix  for  an  input  class  training  sample 
;  (^^ixels  X  #bands) 

Function  cl_cov, class  1 
On_error,  1 
temp=size(classl) 

if(temp(2)  EQ  1)  then  begin 

temp2=moment(class  1 ) 
return,  temp2(l) 

endif  else  return,  coTTe1ate(transpose(classl), /covariance) 

END 

;  IDL  CLASS  MEAN  FUNCTION  -  J.  Laurenzano  (1997) 

;  Hiis  fonction  is  intended  to  determine  the  class 
;  mean  vector  for  an  input  class  training  sample 
;  (#pixels  x  #bands).  The  output  vector  consists  of  the 
;  mean  value  for  each  band  represented  in  the  sample. 

FUNCTION  cl__mean,  class  1 

;On_error,l 

temp=size(classl) 

;print,  *temp*,  temp 
if  (temp(0)  eq  1)  then  numbep=l  $ 
else  number=temp(temp(0)) 

nx=n_elements(class  1  C^,0)) 
muoc==dblarr(number) 

for  i=0,number-l  do  begin 

muoc(i)=total(class  1  (*,i))/nx 

endfor 

return,  muoc 
END 


;  ENVWDL  TflRESHOLDED  DIVERGENCE  BAND  SELECTION  -  J.  Laurenzano  (1997) 
;  (based  on  Rosenblum,  1990) 

;  TDIV  inputs  class  training  samples,  number  of  bands  desired  in  the 
;  output  spectral  subset,  and  probability  misclassification  (generally  . 

;  assumed  to  be  1.0  e-l  5  (Rosenblum,  1997))  The  band  names  of  the 
;  optimal  subset  are  output.  Original  TD  includes  the  statement  (ifl[dr(0)  GT  1)  then  dr=l)r 

. « ]|e  «  Kc  9): « 4c *  4: 4t  #  i|c  *  4c  s|e  He  i(t  9k  *  ♦  *  *  )|(  *  *  ♦  ♦  ♦  4:  *  *  *  4c  4c  *  *  *  *  4c  4: «  *  4:  *  ♦  4c  *  # 4c  *  He  )(e  * 
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pro  quit_event,  event 
widget__control,  event.top,  /destroy 
end 

pro  tdiv_doit,  fid=fid,pos=pos,dims=dims,  out_name=out_name,$ 
numbands=numbands,  prob=prob,  in_memory==in_memory,  r_fid=r__fid 

T=systime(l) 

print,  pos 


envi_file_query,  fid,  fiiame=fiiame,  nb=nb,  ns=ns,nl=nl,  $ 
bnames=bnames,  xstart=xstart,  ystart=ystart 
print,  bnames 
temp=size(pos) 
nb=temp(l) 


;Allocate  memory  array  or  open  output  file 
get  Jun,  unit 

if(m_memory)  then  mem_res=straiT(numbands)  $ 
else  openw,  unit,  out_name 
;stop 

;  Determine  all  possible  spectral  band  subsets 
temp__an=intarr(nb,  numbands) 
tempjarr(*,0)=pos 

for  i=l,numbands-l  do  temp_arr(*,i)=shift(temp_aiT(*,i-l),-l) 

subset=rintarr(nb*(numbands-l),  numbands) 
combination=intarr(nb*(numbands-l), numbands) 
count=0 

while  (count  LT  numbands- 1)  do  begin 
subset(count*nb:count*nb+(nb-l),  *)=temp_arr 
for  j=0,count  do  $ 


temp_aiT(*  ,(numbands- 1  )-j)=shift(temp_arT(  *  ,(numbands- 1  1 ) 

count=count+l 
endwhile 

*  ;  Determine  divergence  value  for  each  possible  spectral  subset 

sub_size=size(subset) 
th_div=dblarr(sub_size(  1)) 

envi_report_setup,  fiiame=fhame,  out_name=out_nanie,  in_memory=0,  $ 
title='Thresholded  Divergence  Calculation',  base=rbase,  /interupt 
envi_report_inc,  rbase,sub_size(l) 

for  q=0,sub_si2:e(l)-l  do  begin 
print,  'total  iterations',  sub_size(l)-l 
envi_report_stat,  rbase,  q,  sub_size(l),  cancel=cancel 
if(cancel)  then  begin 

!  error=envi_cancel_valO 
goto,  trouble 
endif 

;stop 

newpos=nntarr(numbands) 
newpos=subset(q,  *) 
temp=newpos(sort(newpos)) 

;  check  for  bad  and  repeat  combinations 
a_test==n_elements(uniq(newpos)) 

m=0 

check=0 

while  (m  LT  nb*(numbands-l))  do  begin 
now=combination(m,  *) 

;stop 

snow=where(now  eq  temp) 

if(n_elements(snow)  eq  n_elements(temp))  then  begin 

m=nb*(nuinbands- 1 ) 

check=l 

endif  else  m=m+l 
endwhile 

if(a_test  eq  numbands)  AND  (check  EQ  0)  then  begin 
print,  'q',  q 

print,  'newpos',  newpos 
;stop 
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;  Acquire  class  sample  information 
roiJds=envijget_roiJds(fid=fid) 

numclass=n_elements(roi_ids) 

di\^blarr(numclass,numclass) 

for  i=0,  numclass-1  do  begin 
for  j=0,  numcIass-1  do  begin 
;  Form  class  matrices 

roi_addr_l=envi_get_roi(roiJds(i),  roi_name=name,  roi_color=color) 
roi_addr__2=envijget_roi(roiJds(j),  roi jiame^mame,  roi_color=color) 
class  1  =dblaiT(n_elements(roi_addr  1  ),nb) 
class  l=transpose(enyi_get_roLdata(roiJds(i),  fid=fid,  pos=ncwpos)) 
class2=dbIai^n_elements(roi_addr_2),nb) 

class2=transpose(envijget_roi_data(roijds(j),  fid=fid,  pos=newpos)) 

;  Calculate  class  statisfics 
amean=cl_mean(classl) 
bmean=cl_mean(class2) 
bcov=cl_cov(class2) 

;  Calculate  threshold  value 
dt=(-2.)*alog^rob/((2.  *  !pi)^numbands/2.))) 

;  Calculate  ratio  value 

dr=((transpose(amean-bmean)#invert(bcov)#(amean-bmean))  +  $ 
alog(determ(bcov)))/dt 


;if(dr(0)GTl)then  dr=l 
div(i,j)=dr 

endfor ;  end  of  class  loop  (i) 
endfor  ;end  of  class  loop(j) 

;  sum  matrix  elements  and  insert  sum  into  th_div  array 

th_div(q)=total(div) 
combination(q,  *)=temp 
endif  else  th_div(q)=0 
print,  *th__diV,th_div(q) 
endfor  ;end  of  subset  loop  (q) 

!eiTor=0 

trouble:  if(!error  ME  0)  then  envijojerror,  $ 
Thresholded  Divergence  Processing*,  unit=unit 
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print,  ’th_div’,th_div 
;stop 

b=niax(th_div) 

temp=w4iere(th_div  eq  b) 

b_size=n_elements(teinp) 

if(b_size  GT  1)  then  print, "Miltiple  subsets' 

;print,'best',best 
;print,  subset(best,*) 
print,  bnames(subset(temp,*)) 
result=bnames(subset(temp,  •)) 

Time_diff=systime(  1  )-T 
Print,  Time_diff,  'Seconds' 

;  Allocate  Memory  array  or  open  output  file 
getjun,  unit 

if(in_memory)  then  mem_res=strarr(b_size,numbands)  $ 
else  openw,  unit,  out_name 

if(in_memory)  then  mem_res=bnames(subset(temp, "'))  $ 
else  prints  unit,  bnames(subset(temp,  "■)) 
fi’eejun,  unit 

;  Construct  widget  output 

base=widget_base(title='Band  Selection  Output',  /column,  xsize=300,  $ 
xofl^200,  yofi^200) 

quit=widget_button(base,  value=T)one',  event_pro- quit_event') 
list=widget_table(base,  value=result,  uvalue='list',  ysize=numbands,$ 
xsize=b_size) 

widget_control,  base,  /realize 
xmanager,  'wlist',  base 

end 
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pro  tdiv,  ev 

widget_control,  ev.id,  get_uvalue=uvalue 
if  (uvalue  eq  'divergence')  then  begin 

;  Get  input  file 

envi_seiect,  title=Thresholded  Divergence  Input  File',  fid==fid,  $ 
dims=dims,  pos=pos,  /mask,  /roi 

if  (fid  eq  -1)  then  return 
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if  (fid  eq  -1)  then  return 


;  Wfidget  for  input  parameters 
envi_center,  xofi^  yoff 

base==widget_auto  base(  title=Thresholded  Divergence  Input  Parameters') 
sb=vddget_base(base,  /column,  /fi-ame) 
sbl=widget_base(sb,  /row) 

wp=widget_param(sbl,  prompt^TSfumber  of  bands  in  spectral  subset',  $ 
dt=2,  xs=6,  uvalue='numbands',  ceil=n_eIements(pos),  $ 
default=n_elements(pos)/2.0,  /auto) 
sbl=widget_base(sb,  /row) 

wp=widget_param(sbl,  prompt^Trobability  of  Misclassification',  $ 
dt=4,  xs=20,  uvalue=*prob',field=6,  /auto) 
sb=widget_base(base,  /column,  /fi-ame) 

of\v=widget_outfin(sb,  fimc='envi_out  checld,  uvalue='outf ,  /auto) 

;  Automanage  the  widget 

result=auto_wid_mng(base) 

if(result.accept  eq  0)  then  return 

numbands=result.numbands 

print,  numbands 

prob=result.prob 

print,  prob 

tdiv_doit,  fid=fid,  pos=pos,  numbands=numbands,  prob=prob,  $ 
out_name=result.outfname,  in_memory==result.outfin_memory 
endif 
end 
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;  ENVI/IDL  FORWARD  SEQUENTIAL  BAND  SELECTION  -  J.  Lauroizano  (1997) 
;  (adapted  from  Hardie,  1994) 


;  FSBS  inputs  class  training  samples  and  the  number  of  bands 
;  (numbands)  desired  in  the  output  spectral  subset.  Optimal 
;  spectral  bands  are  determined  using  an  iterative  process 
;  based  on  the  Bhattacharyya  Distance. 

> 

pro  quit_event,  event 
\vidget_controI,  event.top,  /destroy 
end 

pro  fsbs  doit,  fid=fid,pos=pos,dims=dims,  out_name=out_name,$ 
numbands=numbands,  in__memory=in_raemoiy,  r_fid=r_fid 
print,  ‘pos’,pos 

envi_file_query,  fid,  fiiame=fiiame,  nb=nb,  ns=ns,nl==nl,  $ 
bnames=bnames,  xstart=xstart,  ystart=ystart 
print,  bnanies(pos) 

;stop 

temp=size(pos) 

nb=temp(l) 

;AlIocate  memory  array  or  open  output  file 
geMun,  unit 

if(in_memory)  then  mem  res=strarr(numbands)  $ 
else  openw,  unit,  out_name 

;  Define  relevant  variables 

mband=fltarr(numbands) 

maxb=dblarr(numbands) 

;  Acquire  class  sample  information 
roMds=envi_get  roMds(fid=fid) 
numclass=n_elements(roiJds) 
B_matrix=dblarr(numclass,numclass) 

;  Establish  Status  Bar 

envi_report  setup,  fiiame=fiiame,  out_name=out_name,  $ 
in_memory=0,  title^Eorward  Sequential  Band  Selection*,  $ 
base=rbase,  rinterupt 
en\i_report_inc,  rbase,  numbands 

;  Begin  sequential  band  selection 
forj=0,numbands-l  do  begin 
en\d_report__stat,  ibase,  j,  numbands,  S 
cancel=cancel 
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if(cancel)  then  begin 
!  error=envicancel_vaI() 
goto,  trouble 
endif 
maxb(j)=0 
print,  'j'J 
;stop 

if(j  EQ  0)  then  begin 
ne\vpos=[0] 
endif  else  begin 

newpos=intarr(j+ 1 ) 
for_now=where(mband  NE  0) 
newpos(0:j- l)=mband(for  now)- 1 
endelse 

for  k=0,nb-l  do  begin 
;  Rule  out  bands  already  included 
z=where(mband  EQ  pos(k)-f  1 ) 
if(z(0)  eq  (-1))  then  begin 
newpos(j)=pos(k) 

;Calculate  B-dist  for  all  class  combinations 
for  r=0,numclass-l  do  begin 
for  s=0,numclass-l  do  begin 

new  size=size(newpos) 

;  Form  class  matrices  and  calculate  class  statistics 
roi_addr_l=envi^et_roi(roiJds(r),  roi_name=name,  roi_color=color) 
roi_addr_2=envi_get_roi(roi  Jds(s),  roi_nanie=name,  roi_color=color) 

if(j  EQ  0)  then  begin 

class  1 =dblarr(n_elements(roi_addr_l ),  new  size(  1 )) 

classl=envi^et__roi_data(roiJds(r),  fid=fid,  pos=newpos) 

class2=dblarr(n_elements(roi_addr_2),new__size(l)) 

class2=envijget_roi__data(roiJds(s),  fid=fid,  pos=newpos) 

amean=cl_mean(classl) 

bmean=cl_mean(class2) 

temp  l=moment(classl) 

acov=templ(l) 

temp2=moment(class2) 

bcov=temp2(l) 

icov=l  ./((acov+bcov)/2.) 

dcov=(acov+bcov)/2. 

tlcov=acov 

t2cov=bcov 

b  1  “1  ./8.  *(amean-bmean)*icov*transpose(amean-bmean) 
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;help,  bl 
endif  else  begin 

classl=dblaFr(n_dements(roi_addr_l),  new_size(l)) 

class  l==transpose(envi_get_roi_data(roi_ids(r),  fid=fid,  pos=newpos)) 

;help,  class  1 

class2=dblarr(n_elements(roi_addr_2),new_size(l)) 
class2=transpose(envi^et_roi_data(roi  jds(s),  fid=fid,  pos=newpos)) 
;help,  class2 
amean=cl_mean(class  1 ) 

;help,  amean 

bmean==cl_inean(class2) 

dielp,bmean 

acov=cl_cov(class  1 ) 

bcov=€l_eov(class2) 

icov=invert((acov+bcov)/2,) 

dcov=determ((acov+bcov)/2.) 

tlcov=determ(acov) 

t2cov=determ(bcov) 

b  1=1/8.  *transpose(amean«bmean)#icov#(aniean-bmean) 

;help,  bl 
endelse 

;  Calculate  Bhattacharjya  distance 

B2=l  ./2.  *alog(dcov/(sqrt(t  1  cov)*sqrt(t2cov))) 

B=B1+B2 
B_matrix(r,s)=B(0) 
endfor ;  end  s  loop 
endfor ;  end  r  loop 
;print,  B  matrix 
temp=tota](B_matrix) 

;  Search  for  maximum  B-distance 
if(temp  GT  maxb(j))then  begin 
maxb(j)=temp 
mband(j)=pas(k)+ 1 
endif 
;stop 

endif 

endfor ;  end  of  class  loop  (i) 

endfor  ;end  of  class  loop(j) 

!error=0 

trouble:  if(!error  NE  0)  then  envMo  error,  $ 

^Forward  Sequential  Selection  ProcessmgVumtr=umt 
envi_report_init,  base=rbase,  /finish 
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mband=mband-l 
print,  'mband*,mband 
print,  bBames(mband) 
result=strarr(numbands) 
result=bnames(mband) 

i^in_memory)  then  mem_res=bnames(mband)  $ 
else  writeu,  unit,  result 
freejun,  unit 

;  Construct  output  widget 

base=widget_base(titIe=Band  Selection  Output*,  /column,  xsize=300) 
quit=widget_button(base,  value=*Done’,  event_pro=*quit_event') 
list=widget_list(base,  value=result,  uvalue='list',  ysize==numbands) 
widget_control,  base,  /realize 
xmanager,  Svlist',  base 

end 

y 

pro  fsbs,  ev 

widget_control,  ev.id,  getjuvalueF=uvalue 
if  (uvalue  eq  ’sequential*)  then  begin 

;  Get  input  file 

envi_select,  title=Torward  Sequential  Band  Selection  Input  File*,S 
fid=fid,  dims=dims,  pos^pos,  /mask,  /roi 

if  (fid  eq  -l)  then  return 

;  Widget  for  input  parameters 
envi_center,  xofi^  yoflF 

base=widget__auto_base(title=TSBS  Input  Parameters') 
sb=widget_base(base^  /colum%  /frame) 
sbl=widget  base(sb,  /row) 

wp=widgetjparam(sbl,  prompt=*Number  of  bands  in  spectral  subset*,$ 
dt=2,  xs=6,  uvalue=*numbands*,  ceil=n_elements^os),  $ 
default=ndements(po&)/2.0,  /auto) 

sb=widgetj?ase(base,  /column,  /fi-ame) 

ofw=widget_outfiii(sb,  fimc=*envi_out_check*,  uvalue=*outf ,  /auto) 

;  Automanage  the  widget 
result=auto_wid_mng(base) 
ifi^result.accept  eq  0)  then  return 
numbands=TesuIt.numbands 
print,  numbands 
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fsbs_doit,  fid=fid,  pos=pos,  numbands=numbands,  $ 
out_name=resuh.outf.name,  in_inemory=resuIt.outf.in_memory 
endif 
end 
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;  SPECTRAL  BASIS  FUNCTIONS  BAND  SELECTOR  - 1  Laurenzana  1998 
;  The  program  is  designed  to  select  the  statistically  optimal 
;  us^*  defined  number  of  bands  for  a  hyperspeetral  image  where 
;  there  are  no  gaps  in  the  spectrum  (ie  the  bands  should  occur 
;  at  equal  intervals  across  the  input  spectrum).  The  user  is. 

;  asked  to  input  the  input  image  file,  spectral  range  minimum 
;  and  maximum  the  increment  separating  adjacent  bands,  the  number  of 
;  bands  which  the  program  should  average  in  the  initial  data  reduction 
;  ( this  value  must  be  less  than  the  total  number  of  bands  divided 
;  by  the  number  of  bands  in  the  output  subset),  the  number  of  bands 
;  in  the  output  subset  (should  be  less  than  10),  and  the  output  file 
;  name.  The  program  will  perform  an  initial  basis  function  calculation. 

;  These  basis  functions  will  be  displayed  •  the  user  will  decide  if 
;  another  iteration  is  desired.  If  another  iteration  is  de^ed, 

;  the  program  will  adjust  the  bands  and  re-calculate  the  basis 
;  fiinctions.  This  process  continues  until  the  user  decides  to  stop. 

;  At  that  pomt  the  selected  interval  maxima  and  minima  are 
;  displayed  and  saved  to  file. 

4:*9k*««**  ******«**«*««*«  *  *)|(***ii:«*4e****  **♦«««  >ti**«*«3ic«***««* 
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pro  quit_event,  event 
widget^Gontrol,  event.top,  /destroy 
return 
end 

.**♦«*«**********  4c*4(*>ic***£Y^2qT  hAI^LER**  *************** 
pro  sbf_doit_event,  event 

;  Get  the  variable  stored  in  the  top  level  base  user  value 
widget^control,  event.top,  get_uvalue=info,  /no_copy 

;  determine  which  action  caused  the  event 
widget^control,  event,  id,  get_uvaiue=buttonvalue 

;  Proc^  based  on  the  button  that  was  pushed 
if  buttonvalue  EQ  ‘cancel’  then  begin 
widget_control,  event.top,  /destroy 

mfo.selection(*,0)==info.bnames(info.int_min(info.interval- 1)) 
info.selection(*,l)=info.bnames(info.mt_max(info.interval'l)) 
info.swave(*,0)=info.waveIength(0,info.int_min(info.interval-l)) 
info.  swave(*^l)=u:db .  wavelei^h(  .u^_max(infb.interval- 1)) 

print,  *result’,info.selection 
print,  “wavelength',  info.swave 

.  «««**♦«*#****««*  Error  Computation  ******************************* 
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;  Initialize  tile 

;tileJd=envi_init_tile(info.fi(l,  info.pos,  num_tiles=num  tiies,  $ 

;  interleave=l) 

;envi_report_setup,  fhame=info,fhame,  out_name=info,out_name,  $ 
;  in_jnemory==0,  title^TError  Computation',  base=rbase,  /interupt 
;envi_report_inc,  rbase,  num_tiles 

;for  i=0,num_tiles-l  do  begin 
;  sum_l=dblarr(info.ns,info.nb) 

;  sum_2=dblarr(info.ns,  info.nb) 

;  sum_la=dblarr(info.ns) 

;  sum_2a=dblarr(mfo.ns) 

;  sum^3=dblarr(info.ns) 

;  envi_report_stat,  rbase,  i,  num_tiles,  cancel=cancel 
;  if(cancel)  then  begin 

;  !error=envi_cancel_valO 

;  goto,  trouble_4 
;  endif 

;  data=envi^et_tile(tile_id,  i,  ys=ys,  ye=ye) 

;  s_new=dblarT(info.ns,  info.numbands) 

;  fGrj=0,  info.numbands-1  do  begin 
;  temp_a==dblarr(info,ns) 

;  if  0  EQ  0)  then  s_new(*  j)^nfo.sJ:emp(*  j,i)  else  begin 
;  for  k=0  j-1  do  temp^a=temp^a+info.bij(j,k)*info.s Jemp(*,k,i) 

;  endelse 

;  s_new(*j)=info.s_temp(*j,i)-temp_a 
;  endfor 

;  temp_b=db!arr(info.ns, info.nb) 

;  for  j=0,info.ns-l  do  begin 
;  for  k?=0,info.numbands-l  do  $ 

;  temp_b0‘,  *)=temp_b(j,*)+s_newO,k)*info.psi(k,  ♦) 

;  endfor 

;  sum_l=(data-temp_b)^2 
;  sum_2=(data)^2 
;  for  j=0,info.ns-l  do  begin 
;  suml  a(j)=totaI(sum_l  (j,*)) 

;  sum2a(j)=totaI(sum_2(j,*)) 

;  endfor 

;  sum_3=sum_la/sum_2a 
;  info.error=info.errorftotaI(sum__3) 

;endfor ;  end  i  loop 
;info.error=100*info.error 
;print,  'error*,  info.OTor 

;Proccss  error  message 
;!error=0 
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;trouble_4:  if(!error  NE  0)  then  envi Jo__error,  *SBF  Pracessing*,urat=unit 
;Clean  up  Tile  Pointer 
;envi_tiIe_done,  tile  id 
;envi_report_init,  base=rbase,  /finish 


;Allocate  memory  array  or  open  output  file 
get^lun,  unit 

if(info,in_memory)  then  mem_res=strarr(info.numbands,2)  $ 
else  openw,  unit,  info.out  name 
;  Store  max  and  min  values  for  selected  bands 
if(info.in^memory)  then  mem^res=info. selection  $ 
else  printf,  unit,  info.selection 
fi-eejun,  unit 

;  Create  output  widget  list 

base=widget_base(title=*Band  Selection  Output*,  /column,  xsize=300) 
sbl==widget_base(base,  /col,  /frame) 
sb_la=widget_base(sbl,  /row) 

labl=widget_label(sb_la^  value='Intewal^>^aimumV  xsize=30,$ 

/align  center) 

lab2=widgetjabel(sb_la,  value='Interval  Maximum*,  xsize=30,  $ 
/align_center) 

sb_lb=widget_base(sbl,  /row) 
listl=widget  list(sb_lb,  value=info.selection(0,*),  $ 
uvalue=*iistr,  ysize=info.numbands,  xsize=15) 
Iistla=widget_list(sb_lb,  value==info.swave(0,*),  $ 
uvalue=’listla*,  ysize=info.numbands,  xsi2e=15) 
list2=vwdget_list(sb  lb,  value=info.selection{l,*),  $ 
uvalue=*list2',  ysize=info.numbands,  xsize^lS) 
list2a^=widget_list(sb_lb,^  value=info,swave(l^*),^  $ 
uvalue='list2a’,  ysize=info.numbands,  xsize=15) 
sb2=widget J)ase(base,  /row,  /frame) 

quit=widget_button(base,  vaIue=*Done*,  event_pro=*quit_event*) 
widget^control,  base,  /realize 
xmanager,  *wlist*,  base 
endifelse  begin 


;********  Interval  f^gneni^nt******************* 
stop 

min  t=dblarr(mfo.num  intervals) 

max_t=dblarr(infomum_intervals) 

info.check=info.check+l 

for  r=0,info.numbands-l  do  begin 
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vafaeF=mfo.niterval(r)- 1 
if(info.refine(r)  eq  1)  then  begin 
ifl[mfo.int_min(vaIue)  LT  infG.nb-2)  AND  $ 

(in&.int_imn(value)  LE  info.int_max(value)-2)  then  $ 
niinjt(value)  =  info.int_niin(vaIue)+l  else  $ 
min_t(vahie)^nfo.int_min(vaIue) 
if(info.intjmax(value)  GT  0)  AND  $ 

(info.int_max(value)  GE  info.mt__min(vaIue)+2)  then  $ 
max_t(value)=info.int_max(value)-l  else  $ 
max_t(va}ue)=info.int_niax(vaIue) 
endif  dse  b^in 
exanr=max(info.psi(r,*)) 
z=where(info-psi(r,*)  EQ  exam) 
print,  V,  z 

if  (exam  GT  0.85)  then  begin 

ifl[z(0)  GE  (2*r+l)*info.average/4)  AND  $ 

(z(0)  LE  3*(2*rH)*info.averag^4)  then  info.test=info.test+l  $ 
else  begin 

if  (z(0)  LT  (2*ri-l)*info.average/4)  AND  (info.int_min(value)  GT  0)then  $ 
niin_t(value)=info.int_nun(value)- 1 
if(z(0)  GT  3*(2*r+l)*info.average/4)  AND  $ 

(info.int_max(vaIue)  LT  mfo.nb-l)then  $ 
max_t(vaiue)==info.int_max(va}ue)+ 1 
endelse 

mlif  dseb^in 

if  (info.int_niin(value)  GT  0)  then  $ 
inm_t(value)^nfo.mt_min(value)-l 
if  (info.int_max(value)  LT  info.nb-1)  then  $ 
max_t(value)=info.int_max(vatue)+l  $ 
else  max_t(vaIue)=info.int_max(vaIue) 
radelse 
endelse 
endfor 

print,  ‘min’,  min_t 
print/max*,  max  t 

> 

;***Repeat  basis  function  computation**** 

;  Definitions 

x_si=dblarr(info,numbands,  info.nb) 
si_g=dblarr(mfo.numbands,  mfo.numbands) 
psi_ten^>=dblarr(info.numbands,  info.nb) 

;  Initialize  data  tiles  using  BIL  format 
tile_id=envi_init_tile(info.fid,  info.pos,  num_tiles=num  tiles,  $ 
intCTleav^l) 


B-15 


print,  ’num_tiles',  nuni_tiies 
;  Setup  processing  status  report 

envi_report__setup,  fiiame=rinfo.fiiame,  out_name=info.out_name,  $ 
in_memory=0,  title^'Basis  Function  Calculation',  base=rbase,  $ 
rinterupt 

envi_report_inc,  rbase,  num_tiles 
info.s_temp=dbIarr(info.ns,  info.numbands) 
for  i=0,  num_tiles-l  do  begin 
envi_report_stat,  rbase,  i,  numtiles,  cancel=cancel 
if(cancel)  then  begin 
!error=envi_cancel_valO 
goto,  trouble_2 
endif 

data=envi_get Jiie(tilejd,  i,  ys=ys,  ye=7e) 

for  j=0,  info.ns-1  do  begin 
fork==0,  info.numbands-1  do  begin 
;print,  *k*,k 

;printy  *nummt^  num^intervaU 
value=info.interval(k)-l  ;**compensate  for  added  1 

;  in  previous  section 

iDfo.s_tenip(j,k)==total(data(j,nun_t(value):niax_t(vaIue)))/  $ 

(info.wavelength(inax_J(value))-info.wavelength(min_t(value))) 

endfor 

endfor 

for  l=0,info.nb-l  do  begin 
for  j=0,info.numbands-l  do  begin 
x_siO,l)==x_si(j,l)+total(data(*,l)*info.s_temp(*,j)) 
for  k=0,iirfo.numbands-l  do  begin 
si_sj(j,k)=si_sj(j,k)  +  total(info.s_temp(*  j)*info.s_temp(*,k)) 

;print,  'sij',si^sj(j,k) 
endfor 
endfor 
endfor 

endfor 

xsi  =  (x_si)/(info.ns*info.nl) 
si_sj=={si_sj)/(info.ns’''info.nl) 

;delvar,  data,  info.sJ:emp 

;  Process  error  messages 
!eiTor=0 
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trouble_2:  if(!error  NE  0)  then  envijo^error,  ‘SBF  Processing’,  unit=unit 
;  Clean  up  tile  pointer 
envi_tile_done,  tilejd 
envi_repott_init,  base=rbase,  /finish 

;  Compute  Basis  Function 
dij=dblarr(info.numbands,  info.numbands) 
dij{0,0)-l 

info,bij=dblarr(info.numbands,  info,nunibands) 
pij=dblarr(info,numbands,  info.numbands) 

psi_temp(0,*)  =  x_si(0,*)/si_sj(0,0) 
newjest=max(psi_temp(0,  *)) 

if  (info.check  GE  1)  AI^  (new^test  LT  max(info.psi(0,*)))  then  $ 
info,refine(0)=l  else  begin 
info.psi(0,*)=psi_temp(0,  *) 

info,mt_min(info.interval(0)-l)=min_t(mfo.interval(0)-l) 
info.int  itiax(infoJnterval(0)-l  )=max  t(info.interval(0)-l ) 
endelse 


for  i=l, info.numbands- 1  do  begin 
value=info.interval(i)«l 
;  Compute  bij 
for  do  begin 

info.bij(ij)=  total(info.psi(j,min_t(value):maxt(value)))/  $ 
(info.wavelength(max_t(value))-info.wavelength(min  t(value))) 
endfor 

;  Compute  dij 
for  j-0,i  do  begin 
if(j  EQ  i)  then  dij(ij)=l  else  $ 
fork^,i-I  do  dij(ij)==dij(ij)+info.bijXi,k)*dij(fcj) 

;  Compute  Pij 
for  k=0,i  do  begin 
for  1=0, i  do  begin 

Py(y)=T>ijCy)+dW.k)*dijOrl)*si_sj(M) 

endfor 

endfor 

endfor 

sum_b=dblarr(info.nb) 

sum_a=dblarr(info.nb) 

for  j=0,i  do  sum_a=sum_a+dij(ij)*x_si(j,*) 

for  j=0,i-I  do  sumjb=sum_b+pij(ij)’*^psi_temp{j,*) 

psi_temp(i,*)=(sum_a  -  sum_b)/pij(i,i) 

print,  *pM_temp*,  psi__temp(i,*) 

new_test=max(psij;emp(i,  *)) 
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if  (info.check  GE  1)  AND  (new_test  LT  inax(info.psi(i,*)))  then  $ 
info.refine{i)=l  else  begin 
info.psi(i,*)=psi_tenip(i,*) 
inf<3,int_nun(value)=min_t(value) 
info.int_max(value)=max_t(value) 
endelse 

endfor ;  end  i  loop 
print,  'min',  info.int  inin 
print,  'max',  info.int  max 
print,  'bij',info.bg 
print,  'dij',  dij 
print,  'pij',  pij 
print,  'psi',  info.psi 
;  Update  User  Query  Widget 
widget  control,  info.list,  set_value=infOipsi 

;  return  the  info  variable  to  the  top  level  base 
widget  control,  event.top,  set_uvalue=infb,  /no  copy 

endelse 

end 

pro  sbf_doit,  fid^fid,  pos=pos,  dims=dims,  init_intervaI=iiBt_interval,S 
file=filej  average=average,  numbands=numbandSj  $ 
out_name=out_name,  in_memory=in_memoiy,  rjBd=r_fid 

envi_file_query,  fid,  fiiame=fiiame,  nb=nb,  ns=ns,  nl=nl,  $ 
bnames=bnames,  xstart=xstart,  ystart=ystart 


;*********rNTF.RVAT.SKT.F.rTTr>'K****'*“'‘****’***‘'‘*************************** 


;  Read  spectral  band  information  file  into  array 

wavelength=fltarr(init_interval,2) 

getlun,  lun 

openr,  lun,  file 

readf,  lun,  wavelength 

fi'eejun,  lun 

priirt,  'wavelength',  wavelength 
print,  'yet  another  testing  new  file' 

;  Initialize  data  tiles  using  BEL  format 

tile_id=envi_init_tile(fid,  pos,  num_tiles=mim_tiles,  interleave=l) 
print,  'num_tiles',  num_tiles 
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;  Setup  processing  status  report 
envi_report_setup,  foame=Wne,  out__name=out_name,  $ 
in__memory=0,  title^’Interval  Seleetiorf,  base=fbase,  $ 
/interupt 

envi_report_mc,  rbase,  numjiles 
;  Definitions 

sp_min=wavelength(0,  *) 
sp_max=wavelength(  1 ,  *) 
test=init_interval  mod  average 
if  (test  eq  0)  then  begin 
numJntervals=init^interval/average 
endif  else  num_mtervals=  fix(init_interval/average  +1) 
x_ave=dblaiT(ns,  nl,  numjntervals) 


for  i=0,  num  Jiles- 1  do  begin 
envi_report_stat,  rbase,  i,  num_tiles,  cancel=cancel 
if(cancel)  then  begin 
!error=envi_cancel_valO 
goto,  trouble 
endif 

;  Retrieve  tile  data « each  tile  represents  each  pixel  of 
;  one  line  in  ail  bands 

data=envi_get__tile(tilejd,  i,  ys=ys,  ye=ye) 

;help,  data 
temp_l=size(data) 

x_temp=dblarr(ns,  num_intervals) 
int_min=dblarr(num_interva!s)  ;  array  address  of  interval 
int_max=dblarr(num_intervals)  ;  min  and  max  wavelengths 
for  j=0,  temp_l(l)-l  do  begin 
for  k=0,  num_intervals-2  do  begin 
int_nim(k)=k*average 
jnt_max(k)==(k+ 1  )*average- 1 
xjtemp(j,k)==total(data(j,int_min(k):intjnax(k))) 
endfor 

int__min(num_intervals-  l)=(num_intervals-  l)*average 
mt_max(num  intervals-l)=nb-'l 
x_temp(j,num  intervals- 1  )=  $ 

total(data(j,int_min(num_mtervals-l):mt_max(ttum_mtervals-l))) 

endfor 

;print,  *xtemp*,x J;emp 
x_ave(*,i,*)^_temp 
endfor 
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print,  'min',  int_min 
print,  'max',  int  max 

;Process  error  message 
!error=0 

trouble:  i^lerror  NE  0)  then  envi_io_error,  'SBF  Processing',  unit=utut 

;  Clean  up  tile  pointer 

envitiledone,  tileid 

envi^report^init,  base=rbase,  /finish 

interval=intarr(numbands) 

;  Rule  out  bands  already  included  and  compute  residual 
for  m=0,numbands-l  do  begin 
print,  'm',  m 

print,  'numintervals',  num  intervals 

res_init=dblarr(num_intervals) 
for  i=0,num_intervals‘‘l  do  begin 
x_h=dblarr(ns,nl) 
z=where(interval  EQ  i+l) 
if(2(0)  EQ  -1)  then  be^ 
xjh=x^ave(*,’'',i) 
sum_2=dblarr(num_intervals) 
sum_3=dblarr(num_intervals) 
forj=0,  num  jntervals-l  do  begin 
q=where(iirterval  EQ  j+1) 
ifi:q(0)  EQ  -1)  AND  0  NE  i)  then  begin 
sum_2(j)=(total((x_ave(*,''‘J))*x_h)y'2 
;print,  'sum2',  sum_2 
sum_3(i)=total{x_h^2) 

;print,  'sum3'j  sum_3 
endif 
endfor 

a=where(sum_3  NE  0) 
if  (a(0)  EQ  *1)  then  res_init(i)=0  $ 
eiseres_init(i)=total(sum_2(a)/sum_3{a)) 
endif  else  res_init(i)=0 
;print,  'res',  res_init(i) 
endfor 

print,  'min',min(res_init(where(res_init  NE  0))) 
b=min(res_init(where(res_init  NE  0))) 

;print,  V,  b 

bl=where(res_init  EQ  b) 

;print,  bl,  bl 

interval(m)=bl  +  l;**Remember  the  added  I""* 
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endfor 

print,  'interval',  interval 

;delvar,  x_h,  sum_l,  sum_2,  x_ave,  x_temp,  data 
^Calculate  ^^asis  Function^ 

;  Definitions 

x_si=dblarr(numbands,  nb) 
si_sj=dblarr(numbands,  numbands) 
psi=dblarr(numbandSj  nb) 

;  Initialize  data  tiles  using  BIL  format 

tilejd=envi_init_tile(fid,  pos,  num__tiles=num_tiles,  interleave==l) 
print,  'num_tiles',  num_tiles 

;  Setup  processing  status  report 

envi_report_setup,  fiiame=fiiame,  out_name=out_name,  $ 
in_memory=0,  title='Basis  Function  Calculation',  base=rbase,  $ 
finterupt 

envi_report_inc,  rbase,  num  tiles 
s  Jemp=dblarr(ns,  numbands) 
for  i=0,  num_tiles-l  do  begin 

envi_report_stat,  rbase,  i,  num_tiles,  cancel=cancel 
if(cancei)  then  begin 

!  error==en\i_cancel_valO 
goto,  trouble_l 
endif 

data=envi _^et_tile(tilejd,  i,  ys=ys,  ye=ye) 

for  j=0,  ns-1  do  begin 
for  k=0,  numbands- 1  do  begin 
;print,  'k',k 

iprint,  'numinf,  num_intervals 

value=interval(k)-l  ;**compensate  for  added  1  in  previous  section 
s_temp(j,k)==(total(data(j,mt_min(value):int_max(value))))/$ 
(wavelength(int_max(value))-wavelength(int_min(value))) 
endfor 
endfor 

for  l=0,nb-l  do  begin 
for  j=0,numbands-l  do  begin 
x__si(j,l)=x__si(j,l)  +  total(data(*,l)*s__temp(*  j)) 
for  t=0, numbands- 1  do  begin 
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;print,  'sij',si_sj(j,k) 
endfor 
endfor 
endfor 

endfor 

x_si={x_si)/(ns*nl) 

sLsjKsLsjy(ns*nl) 

;  Process  error  messages 
lerrorO 

trouble_l:  if{!error  NE  0)  then  envi_io_error,  *SBF  Processing’,  unit=unit 
;CIean  up  tile  pointer 
envi_tile_done,  tilejd 
envi^report^init,  base=Tbase,  /finish 

;  Compute  Basis  Function 

dij=dbIarT(numbands,  numbands) 

bij=dblaiT(numbands,  numbands) 

pij=dblarr(numbands,  numbands) 

dij(0,0)=l 

pij(0,0)=sL5j(0,0) 

psi(0,*)  =  x_si(0,*)/si_sj(0,0) 

for  i=l, numbands- 1  do  begin 
value==mterval(i)^  1 
;  Compute  bij 
for  do  be^ 

bij(ij)=  total(psi(j,int_min(value):int_max(value)))/  $ 
(wavelength(int^max(value))-wavelength(mt  jnin(value))) 
endfor 

;  Compute  dij 
for  j=0,i  do  begin 
ifQ  EQ  i)  then  dij(ij)=l  else  begin 
fork=j,i-l  do  dij(ij)=dy(ij)+bij(i,fc)^dij(k^^ 
dij(ij)=-dij(ij) 
endelse 
;  Compute  Pij 
for  k=0,i  do  begin 
for  1=0, i  do  begin 

py(ij>Tij(U)'^dij(i,k)*dijO,l)*si^j 

endfor 

endfor 

endfor 

sumb=dblarr(nb) 


sum_a=dblarr(nb) 

for  j=0,i  do  suni_a=sum_a+dij{ij)*x_siO’,*) 
for  j=0,i-l  do  suin_b=suin_b+pij(ij)*psi(j,*) 
psi(ij*)=(sum_a  -  sum_b)/pij(i,i) 
endfor ;  end  i  loop 
;print,  bij'jbij 
;print,  'dij',  dij 
;print,  'pij',  pij 
;print,  *psi’,  psi 

;delvar,  sjemp,  data,  x_si,  si_sj 

;  Display  PSI  and  Query  user  for  continuation 
;  Create  User  Interface 

first=  'Press  OK  to  continue.  Press  Cancel  to  end  calculations.* 
result=bnames(interval-‘ 1 ) 
envi  center, xofif,yofif 

base=widget_base(/col,  /frame,  xoffr=xoff;  yoffryofl^  $ 
title='First  Iteration  Basis  Functions') 
sbasel=widget3ase(base,  /col) 
if  (nb  LT  20)  then  n_size=nb  else  n_si2e=20 

list_l=widget_table(sbasel,  xsize=numbands,  ysize=n_size,  value=psi) 
sbase2=widget_bas^ase,  /col) 
labl==widgetjabel(sbase2,  value=first,  /align_center) 
sbase3=widget_base{base,  /frame,  /row) 
c_Jbutton=widget_button(sbase3,  value='Cancei',  uvalue^'cancel') 
ok_button=widget_button{sbase3,  vaIue='OK*,  u\^alue='ok') 

;  Save  information  that  must  be  pass«i  between  the  main  procedure 
;  eind  the  event  handler 

count=intarr(numbands) 

refine=intarr(numbands) 

sdeetion=strarr(numbands,  2) 

swave=fltarr(numbands,2) 

test=0 

check=0 

error=0 

s_temp=dblarr(ns,numbands) 
bij=dblarr(numbands,  numbands) 

info=={fid:fid,  ns:ns,nl:nl,  nb:nb,  sp_min:sp_niin,  sp_max:sp_max,$ 
average:average,  numbands:numbands,  psi:psi,  $ 

out_name:out_name,  in_memory:in_memory,  bnamesibnames,  intervaliinterval,  $ 
wavelength;wavelength,  pos:pos,  fiiame.fiiame,  list:list_l,  test:test,  $ 
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count:count,  checkxheck,  refine:refine,  selection:selection,  $ 
errorxrror,  num_mtervals:num_intervalsjnt_mm:int_min,  $ 
int_max:intjiiax,  s  temp:s_temp,  bij:bij,swave:swave  } 

widget  control,  base,  set juvalue=info,  /no_copy 
;  Realize  the  GUI  and  start  the  Xmanager  loop 
widget_control,  base,  /realize 

xmanager,  *sbf  doit',  base,  event_handler='sbf_doit_event’ 
end 


9 

pro  sbC  ev 

widget_controI,  ev.id,  get_uvalue=uvalue 
if(uvalue  eq  T>asis’)  then  begin 
;  get  input  file 

envi_select,  title=*Spectral  Basis  Function  Input  File',  fid==fid,  $ 
dims=dims,  pos=pos,  /mask,  /roi 
if  (fid  eq  -1)  then  return 

;  Widget  for  input  parameters 
envi_center,  xoflf,  yoflf 

base=widget_auto_base(title='Speetral  Basis  Function  Input  Parameters’) 
top=widget_base(base,  /row) 
sb=widget_base(top,  /column,  /fi-ame) 
sbl=widget_base{sb,  /colum) 

wp==widget_param(sbl,  prompt^'Number  of  Bands  in  Image*,  dt=4,  xs=6,  $ 
uvalue='mit_interval*,  /auto) 
sbl=widget_base(sb,  /colum) 

lab=widget_slabel(sbl,  prompt='Enter  the  spectral  band  information  file  name',$ 
xsize^30,  /fi'ame) 

input=widget_string(sbl,  uvalue='file',  /auto) 
sbi=widget_base(sb,  /column) 

wp=widget_param(sbl,  prompt-Spectral  range  averaging  number',  $ 
dt=4,  xs=6j  uvalue=*average*,  /auto) 
sbl=widget_base(sb,  /column) 

wp=widget^aram(sbl,  prompt='Number  of  bands  in  spectral  subset',  $ 
dt=4,  xs=6,  uvalue=*numbands',  /auto) 
sb=widget_base(top,  /column,  /firame) 

ofw=widgetoutfin(sb,  fiinc-envioutcheck',  uvalue=*outf ,  /auto) 

;  Automanage  the  widget 
resuIt=auto_wid_mng(base) 
if(result.accept  eq  0)  then  return 
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init_interval=result.imt_interval 

file=result.file 

average=result.average 

nuinbands=result.numbands 

sbf_doit,  fid=fid,  pos=pos,  dims=dims,  imt_mterval=initjnterval,$ 
file=file,  average=average,  numbands=numbands,  $ 
out_name=result.outf,name,  in_memory=result.outf.in_memory 
endif 

end 
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;  ENVUIDL  EIGENVECTOR  PRE-SELECTION  METHOD  -  J  Laurenzano  (1997) 


;  PRESC  inputs  training  class  samples  and  the  number  of  bands 
;  in  the  desired  output  subset.  The  eigenvalues  and  eigenvectors 
;  of  the  pooled  covariance  matrix  are  determined  where  pooled  refers 
;  to  the  sum  of  the  individual  class  covariance  matrices.  The 
;  band  names  for  the  optimal  spectral  subset  are  output 
> 

pro  quit_event,  event 
widget  control,  event.top,  /destroy 
end 

pro  presc_do,  fid=fid,pos=pos,  dinis==dims,out_name=out_name,$ 
numbands=numbands,m_memory=in_memory,  r_fid=T_fid 

;  Initialize  optional  keywords 
;!error=0 

;onJoerror,  trouble 
;in_inemory=keyword_set(m_rnemoiy) 

envi_j51e_query,fid,  fiiame=fiiame,nb=nb,  ns=ns,nl=nl,  $ 
bnames=bnames,  xstart=xstart,  ystart=ystart 

;  Allocate  memory  array  or  open  output  file 
get Jun,  unit 

if(in_memory)  then  mem__res=strarr(numbands)$ 
else  openw,  unit,  out_name 

roiJds=envi_get__roiJds(fid=fid) 

;  Establish  Status  Bar 

envi__report__setup,  fiiame=fiiame,  out_name==out_name,  $ 
in_memoiy=0,  title='Eigenvector  Pre-Selection*,  $ 
base=rbase,  /interupt 

envi_Teport^inc,  rbase,  njBlements(roi  ids) 

;  Calculate  pooled  covariance  matrix 
pool=dblarr(nb,nb) ;  Define  pooled  covariance  matrix 
for  i=0,  n_elements(roi_ids)-l  do  begin 
envi_report_stat,  rbase,  i,  n_elements(roiJds),  $ 
cancel=cancel 
if(cancel)  then  begin 
!error=envi_cancel__valO 
goto,  trouble 
endif 

roi_addr==envi _get_roi(foHds(i),roi_name=name,  roi_coIor==color) 
cl jnatrix=dblarr(n^elements(roi jiddr),nb) 
for  j==0,nb-l  do  begin  ;  fill  class  matrix 
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cl_matrix(*j)=envi _get_roi_data(roiJds(i),fid=fid,pos=pos(j)) 
endfor 

pool=pool+cl_CGv(cI__inatrix) 
;result=envi_get__roi_data(rondsOXfid=fidipos=pos(l)) 
help,  pool 
endfor 

!error=0 

trouble:  if(!error  NE  0)  then  enviJo_eiTor,  $ 

Eigenvector  Pre-Selection  Processing*,  unit=unit 
envi_report_init,  base=rbase,  /finish 

;  Calculate  eigenvalues  and  eigenvectors  of  pooled  cov  matrix 

evaI=hqr(elmhes(pool),  /double) 

residual=l 

evec=eigenveG(pool,eval^  residual=residual) 
help,  evec  . 

;print,  'evec*,evec 

;  Select  the  best  M  spectral  bands  fi^om  the  entire  set- 
;  inspect  the  first  M  eigenvectors  for  the  band  with  the  highest 
;  positive  or  negative  loading  in  each  eigenvector 
spmax=dblarr(nuinbands) 
for  i=0,numbands-l  do  begin 
temp=dblarr(nb) 
temp=evec(*,i) 
temp=sqrt(temp^2) 
count_2=0 

order=reverse(sort(temp)) 
while(spmax(i)  eq  0)  do  begin 
a_test=where(spmax  eq  order(count_2yi-l ) 
print,  “test^a^test 

tf(a  test(0)  eq  -1)  then  spmax(i)=order(count_2)+  I  $ 
else  count_2=count_2+l 
print,  'count*,  count__2 
endwhile 
endfor 

spmax=spmax-l 
print,  spmax 
print,  bnames(spmax) 

;print,  pos(spmax) 
result=bnames(spmax) 

;  Output  data 

if(in_memory)  then  mCTa_res=bnames(spmax)  $ 
else  printf,  unit,  bnames(spniax) 
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free_lun,  unit 


;  Create  output  widget  list 

base=widget_base(title='Band  Selection  Output',  /column,  xsize=300) 
quit=widget_button(base,  value=T)one',  event_pro='quit_event') 
list=widget_list(base,  value=resultj  uvalue=1ist',  ysize=numbands) 
widgetcontrol,  base,  /realize 
xmanager,  Vlist',  base 

end 

> 

pro  presc,  ev 

widget_control,  ev.id,  get_uvalue=uvalue 
if  (uvalue  eq  'prescreen')  then  begin 

;  get  input  file 

envi  select,  title=Tre-Screen  Input  File',  fid=^d,  dims=dims,  $ 
pos=pos,  /mask,  /roi 
if  (fid  eq  -1)  then  return 

;  Widget  for  iiq)ut  parameters 
envi_center,xoflF,yoff 

base=widget_auto_base(title='Pre-Screen  Input  Parameters') 
sb=widgetbase(base,/column,/firame) 
sb  l=widget_base(sb,/row) 

wp=widget_param(sbl,prompt='Number  of  bands  in  spectral  subset',  $ 
dt=2,  xs=6,uvalue='numbands*,  ceiI=n_eIements(pos),  $ 
default=n_elements(pos)/2,0,  /auto) 
sb=widget_base(base,/column,/fi‘ame) 
ofw=widget_outfin(sb,fiinc='envijout_check',  $ 
uvalue='outfyauto) 

;  Automanage  the  widget 
result=auto_wid_mng(base) 
if  (result.accept  eq  0)  then  return 
numbands=resultnumbands 
;print,  numbands 

presc jlo,  fid=fid,pos=pos,dims=dims,numbands=numbands,$ 
out_name=result.outfname,  m_memoT3FTesult.outfin_memory 
endif 
end 
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;  ENVI/IDL  SIGNAI/-TO^CLUTTER  RATIO  CLASSIFIER  -  J.  Laurenzano  (1997) 


;  This  classifier  is  intended  for  use  with  target/background  imagery. 

;  Target  and  background  class  training  samples  are  input.  A  classified 
;  image  is  output. 


pro  scrl_doit,  fid=fici,pos=pos,dims=dims,out_name=out_name,  $ 
numbands=numbands,  in_memory=in_memory,  r_fid=r_fid,  $ 
target=target,  thold=thold 

envi_file__query,  fid,  fiiame=fiiame,  nb=nb,  ns=ns,  nl=nl,  $ 
bnames=bnames,  xstart=xstart,  ystart=ystart,  interleave=mterleave,  $ 
data_type=data_Jype 
printj  'data  type’,  data_type 

tile_interleave=interleave 

temp=size(pos) 

nb=temp{l) 

;  Allocate  memory  array  or  open  output  file 
get^lun,  unit 

if(m_memory)  then  mem_res=dblarr(ns,nl)  $ 
else  openw,  unit,  out_name 

;  Calculate  class  covariance  matrix 

roi_ids=envi^et_roi_ids(fid=fid) 

num_class=n_elements(roMds) 

cov_iiiatrix^blaiT(nb,nb,num_class) 

tempa=si2e(bnames) 

namejype=tempa(2) 

cI_names=make_array(n_elements(roi Jds),  type=name_type) 
cl_color=lonarr(3,num_class) 

for  i=0,num__class-l  do  begin 

roi_addr=en\ijget_roi(roiJds(i),  roi_name=name,  roi_color=color) 

cl_matrix=dbIarr(ndements(roi_addr),  nb) 

cl_names(i)=name 

cl_color(*,i)=color 

for  j=0,  nb-1  do  be^ 

cl_matrix(*  j)=envi_^et__roi_data(roiJds(i),  fid=fid,  pos=pos(j)) 
endfor 
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;  Fill  covariance  matrix 
cov_matrix(* ,  *,i)=cl_cov(cl_matrix) 
endfor 

;  Assign  target  and  background  class  positions 

if(  target  eq  1)  then  begin 
t=0 

b=l 

endif  else  begin 
t-1 
b-0 
endelse 

;  Initialize  the  data  tiles  using  BIP  format 
tilejd=envi_init_tile(fid,  pos,  num_tiles=niim_tiles,  interleave=l) 
print,  ’numtUes',  num_tiles 

;Setup  processing  status  report 

envi_report_setup,  fiiame=fiiame,  out_name=out_name,  $ 
in_memory=0,  title='Signal  to  Clutter  Classified,  base=rbase,  $ 
finterupt 

envi_report_inc,  rbase,  num_tiles 

sig=dblarT(ns,nl) 

for  i=0,  num_tiles-l  do  begin 
envi_report_stat,  rbase,  i,  num_tiles,  cancel=cancel 
if(cancel)  then  begin 
!  error=en\i_canceWalO 
goto,  trouble 
endif 

;  Retrieve  tile  data  -  each  tile  represents  each  pixel  of 
;  one  line  in  all  bands 

data=envi _get_tile(tilejd,  i,  ys=ys,  ye=ye) 
temp=size(data) 


;  Calculate  SCR 
;  Select  each  image  pixel 


for  r=0,  temp(l)-l  do  begjn 
pixel=dblarr(temp(2)) 
pixel=data(r,*) 
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sig(r4)==T)ixel#invert(a)v_mtrk(*,*,^  transpose(pixel) 
endfor  ;endr-Ioop 

endfor  ;endi-loop 

result=fltarr(ns,nl) 

threshold=thold*max(sig) 
back:==where(sig  LT  threshold) 
tg=where(sig  GE  threshold) 

if(back(0)  eq  - 1)  then  begin 
resuit=result+t 
print,  'no  background',  r 
endif 

if(tg(0)  eq  -1)  then  be^ 
result=result+b 
print,  'no  target*, r 
endif 

if  (back(O)  ne  -1)  and  (tg(0)  ne  -1)  then  begin 
print,  *num  bg',  n_elements(back) 
print,  *num  target',  n_elements(tg) 
print,  'total',  n_elements(baGk)+n_elements(tg) 
result(back)=result(back)+b 
result(tg)=result(tg)+t 
endif 

;  Write  output  to  memory  or  output  file 
ifi[in_memory)  then  mem_res=result  $ 
else  writ^,  unit,  result 

;  Process  error  messages 
!error=0 

trouble:  if(!errorNE  0)  then  envi_io_error,  'SGR  Processing',  $ 
unit=unit 
fi'ee^Iun,  unit 

;  Clean  up  tile  pointer 
envi_tile_done,  tilejd 
envi  report_init,  base=rbase,  /finish 

if([error  EQ  0)  then  begin 

;Add  the  processed  file  to  the  available  band  list,  the  output 
;  file  will  inherit  the  wavelength  and  band  information  fi-om  the  input  file 


B-31 


inherit={fid:fi(l,  posrpos,  flag:3) 
descrip='SCR  Classification' 
ifijin  memoty)  then  $ 

envi_enter_dataj  mem_res5  descrip=descrip,  r_fid=r_fid,  $ 
inherit=iidierit,  num_classes=num_class,  class_names=cl_names,  $ 
lookup=cI_color,  bnames-SCR'  $ 
else  $ 

envi_setup_head,  fiiame=out_nanie,  ns=ns,  nl=nl,  nb=I,  $ 
r_fid=r_fid,  inherit=inherit,  descrip=descrip,  xstart=xstart,  $ 
ystart=ystart,  $ 

lookup=cl_color,  data_type=data_type,  $ 
interleave=0,bnames=out_name/write,/open 
endif 

end 

> 

proscrl,ev. 

widget  control,  ev.id,  get_uvalue=uvalue 
if(uvalue  eq  ’scrl’)  then  begin 
;  Get  input  file 

envi_select^  title='SCR  Input  File*,  fid=fid,  diins=dims,  pos=pos,  $ 

/mask,  /roi 

if(fid  eq  -1)  then  return 

;  Widget  input  parameters 
envi  center,  xofF,  yofF 

base=widget_autoJbase(title=*SCR  Input  Parameters*) 
sb=widget_base(base,  /column,  /firame) 
sbl=widget_base(sb,  /col) 

wp=widget _j)aram(sbl,  prompt=Region  of  Target  Class  Representation',  $ 
uva]ue='target*,  default=l,  /auto) 
sbl==widgetjbase(sb,  /col) 

wp=widget_param(sbl,  prompt- Threshold  (percentage  of  maximum  value)',  $ 
uvalue=thold',  default=0.75,  /auto) 
sbl=widget_base(sb,  /col) 

ofw=widget_outfin(sbl,  func-envi_out__check',  uvalue=’outf,  /auto) 

;  Automanage  the  widget 
result=auto_wid_mng(base) 
if{result.accept  eq  0)  then  return 
target=result.target 
thold=result.thold 
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scrl_doit,  fid=fid,  pos=pos,  dims=dims,  out_name=result.outf.name,  $ 
in_memory==result.outf.injiiemory,  target=target,  thoId=thold 
endif 

end 
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;  ENVI/IDL  LOG-LEKELIHGOD  RATIO  CLASSIFIER  -  J.  Laurenzano  (1997) 


;  This  classifier  is  intended  for  use  with  target/background  images. 

;  Target  and  background  class  training  samples  are  input  in  addition 
;  to  both  target  and  background  class  probabilities.  A  classified 
;  image  is  output. 

.  4c  *  «  *  ♦  *  *  *  *  ♦  *  *  ilcii:  )|e  lie  ♦  *  *  *  lie  *  )f(  *  ♦  4c  ♦  *  *  «  ♦  *  4:  ♦  4i «  *  4c  4c  4s  * 

pro  log_doit,  fid=fid,pos=pos,  dims=dims,out_name=out_name,  $ 
numbands=numbands,in_memory=in_memory,  r_fid=r_fid,  $ 
tprob=tprob,  bprob=bprob,  target=target 

envi_file_query,fid,fhame=fhame,nb==nb,ns=ns,nl=nl,$ 
bnames=bnames,xstart=xstart,ystart=ystart,  interleave=interleave,$ 
data_type=data_type 

tile_interleave=interleave 

temp=s}ze(pos) 

nb==temp(l) 

;Allocate  memory  array  or  open  output  file 
getjun,unit 

if(in_memGry)  then  mem_res=dblarr(ns,nl)  $ 
else  openWjUnitjOut_name,  /block 

;  Calculate  class  covariance  matrix 

roiJds=envijget_roMds(fid=fid) 

num_class=n_elements(roi_ids) 

GOv_inatrix=dblarr(nb,id)*num_class) 
mean_matrix=dblarr(nb,  num  class) 
tempa=size(bnames)  ;  Form  array  containing  class  names 
name_type=tempa{2) 

cl_names=make_array(n_elements(roi_ids),  type=name Jype) 
cl_color=lonarr(3,num_class) 

for  i=0,num_class-l  do  begin 

^oi_addr=en^dJget_roi(roi Jds(i),  roi_name=name,  roi_color==color) 

cl_matrix=dbIaiT(n  elements(roi__addr),  nb) 

cl_names(i)=name 

cl_color(*,i)==color 

for  j=0,  nb-1  do  begin  ;  Fill  class  matrix 
cl_matrix(*  j)  =  envi^et_roi_data(roHds(i),  fid=fid,  pos=pos(j)) 
endfor 

;  Fill  covariance  matrix 
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cov_matrix(*,  *  ,i)=cl_cov(cl_matiix) 
mean_rnatrix(*4)=cl_mean(cl_matrix) 
endfor 

help,  cov_matrix 
print,  cl_names 
print,  cl_color 
print,  ‘mean*,  mean_matrix 
;  Assign  target  and  background  class  positions 
if(target  EQ  1)  then  begin 
t=0 

b^l 

endif  else  begin 

t=l 

b=0 

endelse 

initialize  the  data  tiles  using  BIP  format 
tile_id=envi_init_tile(fid,pos,  num_jiles=num_tiles,  interleave=l) 
print,  'interleave*,  interleave 
print,  'num_tiles’,  num_tiles 

;  Setup  the  processing  status  report 
envi_report_setup,  fiiame=fiiame,  out_name=out_name,  $ 
in_memory=0,  title=*Log-Likelihood  Ratio  Classifier',  base=ri)ase,  $ 
/interupt 

envi_report_inc,  rbase,  numjiles 

for  i=0,  num_tiies-l  do  be^ 
envi  report  stat,  rbase,  i,  num_tiles,  cancel=cancel 
if  (caned)  then  begin 
!error=envi_cancel_valO 
goto,  trouble 
endif 

;  Retrieve  tile  data  -  each  tile  represents  each  pixel  of 
;  one  line  in  all  bands 

data=envi_get__tile(tile Jd,  i,  ys=ys,  ye=ye) 

temp=size(data) 

result=dblarr(temp(l)) 

;  Calculate  Log-Likelihood 
ratio=aIog(tprob/bprob)-l/2.*  $ 
alog(determ(cov_inatrix(*,*,b))/detenn(cov_matrix(*,*,t))) 

;  Select  each  image  pixel 
for  r=0,  temp(l)-l  do  begin 
pixel=dblaiT(temp(2)) 
pixel=data(r,*) 
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sum==(l/20‘^(pixel-mean_matrix(*,b))^  $ 
invert(cov_matrix(*,*,b))#  (transpose(pixeI“mean_matrix(*,b)))  -  $ 
(1/2.)  *(pjxd-me^_matFix(*,t)}  #  $ 
invcrt(cov_matrix(*,*,t))#(transposc(pixcI-nic^_rnatri:^(*,t))) 

if(suin(0)  GT  ratio)  then  resuh(r)=t  dse  resuk(r)=b 


;  Write  output  to  memory  or  output  file 
endfor ;  End  r  loop 

if(in_memory)  then  mem  res(*,i)=result  $ 
else  witcu,  unit,  result 
endfor ;  End  i  loop  (tile  loop) 

;Process  error  message 
!error=0 

trouble:  if(!OTor  NE  0)  th^  envi_io_error,lx)g-hkelihood  PFOcesrii^',$ 
unit=mnit 
fi-eejun,  unit 
if(!error  EQ  0)  then  begin 

;  Add  the  processed  file  to  the  available  band  list,  the  output 
;  file  will  inherit  the  wavelength  and  band  information  from 
;  the  input  file 

uiherit={fid:fid,  pos:pos,  flag:3} 
descrip=’Log-Likelihood  Classification' 
if  (m_menK^)  then  $ 

envi_enter_data,  niem__res,  descrip=descrip,  r_fid=r_fid,  $ 
inhcrit=inbcrit,  num_classcs=puta_class,  class_namcs=cljamcs,  $ 
lookup=cl_color  $ 

else  envi^setupjiead,  fiiame=outjtame,  ns=ns,  nl=nl,  nb=l,  $ 
r_fid==r_fid,  inherit=inherit,  descrip=descrip,  xstart=xstart,  $ 
ystart==ystart,  num_classes=num_class,  class_names=cl_names,  $ 
Iookup=cl_color,  /write,  /open 
endif 


;  Clean  up  tile  pointer 
envi__tiIe_done,  tile_id 
envi__report_imt,  bas€=ibasej  /finish 


end 

.  «  4  A  Ik  4(  4  4e  lie «  4  4:  ik  4  *  4  )ie  *  lit  *  ije  *  4:  *  *  4c  4  «  4  lie  lit  tie «  *  ii(  4  4(  4  *  4(  )k  ik  4  «  4  *  *  4  «  4 

>  . 

pro  log,  ev 

widget_Gontrol,  ev.id,  get_uvalue^value 
if(uvalue  eq  log')  then  begin 
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;  Get  input  file 

envi__select,  title^Log-Likelihood  Input',  fid=fid,  dims=dims,  pos=pos,  $ 
/mask,  /roi 

if(fid  eq  - 1)  then  return 

;Widget  input  parameters 
envi__center,xoff,yoff 

bas€===widget__auto_base(title='Log-Iikelihood  Input  Parameters') 

sb=wdgct_basc(basc,/column,/framc) 

sbl=widget_base(sb,  /column) 

wp==widget_param(sbl,  prompt=Probability  of  Target  Class',  $ 
dt=4,  xs=6,  uvaIue='tprob*,  default=0.5,  /auto) 
sbl==widget_base(sb,  /column) 

wp=widget  param(sbl,  prompt='Region  of  Target  Class  Representation', $ 
uvalue='target',  default=  1,  /auto) 
sbl=TOdget_base(sb,  /column) 

\vp=widget_param(sbl,  prompt^'Probdfility  of  Background  Class',  S 
dt==4,  xs==6,  uvaIue=='bprob*,  default=0.5,  /auto) 
sb=wkiget_base(sb,  /column,  /fi-ame) 

ofw=widgct_outfm(sb,func=*cnvi_out_chcck',uvaluc='outf,/auto) 

;  Automanage  the  widget 

result=auto_wid_mng(base) 

ifl[result.accept  EQ  0)  then  return 

target==result.target 

tprob=result.tprob 

bprob=result,bprob 

log  doit,  fid=fid,  pos=pos,  dims=dims,  out_name=resuIt.outf  name,  $ 
in_memory=result.outf  in_memory,  tprob=tprob,  bprob=bprob,  $ 
taFget=taFget 
endif 

end 
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;  IN1>EPENI>ENT  ANALYSIS  CONFUSION  MATRIX  -  J  Laurenzana,  1997 


;  This  program  was  developed  to  produce  a  confusion  matrix 
;  based  on  independent  sampling  techniques.  The  ROI  file  used 
;  for  classification  should  be  renamed  and  a  new  ROI  fife 
;  specifically  intended  for  fixe  accuracy  assessment  must  be 
;  created.  The  first  input  image  should  be  the  original  image  with 
;  which  the  new  ROI  data  is  associated.  The  second  input  image  should  be 
;  the  class  map  image.  The  program  will  print  out  a  labeled  confusion 
;  matrix  in  the  IDL  window.  If  selected,  the  program  will  also  output 
;  the  confiision  matrix  and  class  names  into  an  output  file  named 
;  by  the  user. 


.  p 3k* i((ijt****i(<ijtJii**** *********** Jit 


pro  con^doit,  fid_l=fid_l,  fid__2=fid_2,  pos_l=pos_l,  pos_2=pos_2,  $ 
dims_l=dum_l,  dims_2=dims_2,  out_name=out_name,  $ 
in_memory^in_memory,  r_fid_l=r_fid_l,  r_fid_2=r_fid_2 

;  Allocate  memory  array  or  open  output  file 
;get  Jun,  unit 

;if(in_memory)  then  mem_res-intarr(numclass,  numdass-i'l)  $ 

;  else  openw,  unit,  out_namc 


print,  fid2Vfid_2 
print,  *fidr,  fid__l 

;  Gather  image  data 

envi_file_query,  fid_l,  fiiame=fhame,  nb=nb,  ns=ns,  nl“nl,  $ 
datajfeype=data_type,  bnames=bnames 
ns_l=ns 
nl_l=nl 

bnames_l=bnames 

tempa=size(bnames_i) 
name__type=tempa(2) 
print,  ’ns_V,  ns_l 

envi_file_query,  fid_2,  fhame=fiiame,  nb=nb,  ns=ns,  nl=nl,  $ 
data_type=data_type 
ns_2=ns 
pl^2=ri. 

print,  'ns_2',  ns__2 

;  Retrieve  classified  image  pixel  values 
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tile_ki=envijnit_tile(fid_2,  pos_2,  imm_tiles=num_tiles,  interleave) 
print,  -num  tiles',  num_tiles 

data=intarr(ns_2,nl_2) 

for  i=0,  num_tiles-l  do  begin 
data{*,i*nl_2/num_tiles:(i+l)*nl_2/num_tiles-l>=$ 
envi^et_tile(tile Jd,  i,  ys=ys,  ye=ye) 
print,  Valucs’,inax(data) 
print.  Values’,  mm(data) 
endfor 

;  Define  confusion  matrix 
numdass=max(data) 
c_niat=mtarr(numclass,  numclass+l) 

;  Allocate  m^ory  unit 
get_iun,unit 

if(injnenioiy)  then  niemres=intarr(numclas&,numdass+l)  $ 
else  openw,  unit,  out_natnc 

;  Retrieve  ROI  information 
roiJds=envi^et_roi_ids(fid=fid_l ) 
cl_name&=makearray(n_d^ients(roi_ids),  type=nanie_type) 
for  i=0,  n_elements(roi_ids)-l  do  begin 

roi_addr=en\njget_roi(roi_ids(i),  roi_color=color^  roi_name=name) 

cl_names(i)-name 

;print  n_elements(roi_addr) 

;print  'rois*,roi_ids 

forj=0,  n_dements(roi_addr)-l  do  begin 
xioc=Toi  addr(j)  mod  ns_2 
;help,  data 
;print,  V,  xloc 
;print,  roi__addr(j) 

;print,  ns_2 
yloc=roi_addr(j)/ns_2 
;print,  yloc 

if(data(xloc,  yloc)  eq  Q)  then  begin 
c_mat(i,numclass)=c_mat(i,numclass)+l 
endif  else  begin 

c_mat(i,  data(xloc,yloc)- 1  )-c_mat(i,data(xloc,yIoc)- 1 )+ J 
endelse 

endfor 

endfor 
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print,  c_mat 


;  Store  output  confusion  matrix 
if(in_memory)  then  mem_res=c_mat  $ 
else  printC  unit,  c_mat 
freejiun,  umt 

end 

pro  conC  ev 

widget  control,  ev.id,  get_uvaluo=uvalue 
ifi^uvaluc  cq  'confusion')  then  begin 
envi_select,  title- Independent  Analysis  Truth  Image',$ 
fid=fid,  dinis=dims,  pos=pos,  /mask,  /roi 
fidj=fid 
dims_l=dims 
pos  l=pos 

if(fid  eq  -1)  then  return 

envi_select,  title- Independent  Analysis  Classified  Image',  $ 
fid=fid,  dims=dims,  pos=pos,  /mask,  /roi 
fid_2=fid 
dims_2=dims 
pos_2=pos 

ifi^fid  eq  -1)  then  return 

;wddget  input  parameters 
envi_center,  xoff,  yofF 

base=widget_auto_base(title='Independent  Analysis  Confusion  Matrix  Input') 
sb=widgct_base(base,  /row,  /firamc) 

ofw=Wi'idget_outfin(sb,  fiinc- envi_out_check',  uvalue='outf,  /auto) 
;Automanage  the  widget 
resuIt=auto_wid_mng(base) 
ifl^result.accept  eq  0)  then  return 

conf  doit,  fid  l^d  1,  fid  2=fid  2,  pos  l=pos  1,  dims  l=dims  1,  $ 
pos_2=pos_2,  dims_2=dims_2,  out_name=TesuIt.outf.name,  $ 
in_memoiy=resuIt.outfin_memory 
endif 

end 
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;  INDEPENDENT  ANALYSIS  ROC  MATRIX  CALCULATION  -  J.  Laurenzano  - 1997 


;  The  user  must  input  the  original  image  with  specifically  selected  ROI’s 
;  (ie  not  those  used  for  classification)  as  the  truth  image.  The 
;  classimage  is  the  output  of  Ae  target  id  classification  algorithm, 

;  The  target  class  must  be  either  region  1  or  re@on  2.  The  ou^ut 
;  matrix  can  be  written  to  a  file  for  further  analysis  and  plotting 
;  using  either  IDL  or  a  spreadsheet  program. 

pro  in  roc^doit,  fid__l=fid_l,  fid_2=fid_2,  pos_l=pos_l,  pos_2=pos_2,  $ 
dims_l=dims_l,  dims_2=dims_2,  out_name==out_name,  $ 
m_memoiy=in_memory,  r_fid_l=r  fid_l,  r_fid  2=T_fid_2,  target=target 

print,  ‘fid2',  fid_2 
print,  fidi',  fid_l 

;Allocate  m«nory  array  or  open  output  file 
get_lun,unit 

if(in_menioiy)  then  mem_res==dblarr(2,2)  $ 
else  openw,  unit,  out_namc,  ^Iock 

envi_fiie_query,  fid_l,  fiiame=fiiame,  nb=nb,  ns=ns,  nl=nl,  $ 
data_type=data_type 
ns_l=E& 
nl_l=nl 

print,  'ns_r,  ns_l 

envi_file_query,  fid_2,  fiiame=fiiame,  nb=nb,  ns=ns,  nl=nl,  $ 
data_typ^ata_type 
ns_2=ns 
nl  2=nl 

print,  *ns_2',  ns_2 

;  Retrieve  classified  image  pixel  values 
data=intarr(ns_2,nl_2) 

tile_id=envi_init_tile(fid_2,  pos_2,  num_tiles=num__tiles) 
print,  Yiumjtiles*,  num^tiles 
for  1=0,  numjtiles-1  do  begin 
data(*,i*nl_2/num_tilcs  :(i+ 1 )  *nl_2/numtilcs- 1  )=$ 
en\djget_tile(tilejd,  i,  ys=ys,  ye=ye) 
print,  Values*,max(data) 
print.  Values*,  min(data) 
endfor 

;  Define  Target/Background  Regions 
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if  (target  eq  1)  then  begin 
tg=0 
bg=l 

cndif  else  begin 
tg=l 
bg=0 
endelse 

;  Define  ROC  matrices 

roc_l=mtarr(2,2) 

roc__per=fltarr(2,2) 

;  Retrieve  ROI  information 
roiJds=envi^et_roiJds(fid=fid_l) 
for  i=0,  n_elemetits(foMds)-l  do  begin 
roi_addr=envijget_roi(roi Jds(iX  roi__color=color) 

;print,  n_eIements(roi_addr) 

;print,  *rois*,ronds 

forj=0,  n_dements(roi__addr)-l  do  begin 
xloc=Toi_addr(j)  mod  ns_2 
yloc=roi_addr(j)/ns_2 

if(i  eq  tg)  then  begin 
y(data(xloc,yloc)  eq  tg)  then  be^ 
roc__l(0,0)=roc_l(0,0)+l 
cndif  ckc  bc^ 
roc_l(l,0)=roc_,l(l,0)+l 
endelse 

endif  else  begin 

if(data(xIoc,yloc)  eq  bg)  then  begin 
roc_l(l,l)=roc_l(l,l)+l 
endif  else  begin 
roc_l(0, 1)=roc_I  (0, 1)+1 
endelse 
endelse 

endfor 

endfor 

print,  ’roc',  roc_i 
roc_tot=total(roc_l) 
roc_per=roc_l/roc_tot  *  100 
print,  ’percent*, roc^per 
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if(in_memory)  then  mem_res=roc jper  $ 
else  prints  unit,  roc_per 
freejun,  unit 
end 

♦He******************** *♦*♦** ♦**♦**♦***♦♦♦**♦♦♦♦♦♦♦♦ 
j 

pro  in_roc,  ev 

widget_control,  ev.id,  get_uvalue=uvalue 
iffuvalue  eq  *inroc*)  then  begin 
envi  select,  title=*Independent  Analysis  Truth  Image', $ 
fid=fid,  dims=dims,  pos==pos,  /mask,  /roi 
fidj=fid 
dims  l=dims 
pos_l=pos 

if(fid  eq  -1)  then  return 

envi  select,  title=*Independent  Analysis  Classified  Image',  $ 
fid=fid,  dims=dims,  pos=pos,  /mask,  /roi 
fid_^2=fid  . 
dims_2=dims 
pos___2=pos 

if(fid  eq  -1)  then  return 

;widget  input  parameters 
envicenter,  xofl;  yoflf 

base=widget_auto  J)ase(title='Independent  Analysis  ROC  Matrix  Input’) 

sb=widgetjbase(base,  /row,  /frame) 
sbl=vwdgetj)ase(base,  /col) 
wp=widget_j)arani(sbl,  $ 

prompt='Rc^on  of  Target  Class  Representation  (1  or  2)',  $ 
uvalue='target*,  default=l,  /auto) 
sbl=widgetjbase(base,  /col) 

ofw=widget_outfin(sbl,  func-envi_out_check*,  uvalue='outf,  /auto) 

;Automanage  the  Widget 

result=auto_wid_mng{base) 

if(result.accept  eq  0)  then  return 

target=result.target 

in_roc_doit,  fid_l=fid_l,  fid_2=fid_2,  pos_l=pos_l,  dims_l==dims_l,  $ 
pos_2=pos_2,  dims_2=dims_2,  out_name=result,outf.name,  $ 
in_meniory=result.out£in_memory,  target=taiget 
endif 

end 
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;  STRATIFIED  RANDOM  SAMPLING  CONFUSION  MATRIX  -  J.  Laurenzano  1997 

;  This  program  is  designed  to  allow  the  user  to  input  truth  data 
;  for  each  randomly  sampled  image  pixel.  Initially,  the  program 
;  requires.that  die  user  enter  the  class  map  image,  the  original 
;  image,  and  the  desired  number  of  truning  pixels.  The  progrm 
;  later  asks  the  user  to  select  the  three  spectral  bands  for 
;  image  display.  The  program  generates  random  pixel  coordinates 
;  and  di.splays  a  portion  of  the  original  image  with  cro.ss  hairs 
;  marking  the  location  of  the  pixel  in  question.  The  user  must 
;  select  the  landcover  class  to  which  the  pixel  belongs.  Printed 
;  output  in  the  IDL  window  consists  of  a  confusion  matrix  with 
;  appropriate  row  and  column  headings.  The  columns  represent  truth. 

;  Only  the  numeric  portion  of  the  confiision  matrix  is  stored  to  file. 

;  Thus  it  is  imperative  that  the  user  mmntain  thorough  records  for 
;  each  file. 

;***NOTE**  IF  -1  APPEARS  IN  THE  PIXEL  CLASS  INPUT  WINDOW  THE  USER 
;  SHOULD  HIT  OK  FOR  THE  PIXEL  SELECTION  TO  CONTINUE 

pro  st_con^doit_event,  event 

;Get  the  variable  stored  in  the  top  level  base  user  value 
widget  control,  event.top,  get  uvaiue=mfo,  /no  copy 

;detennine  which  action  caused  the  event 
widget^control,  event.id,  get_uvaIue=buttonvaIue 

;Proce«J  based  on  the  button  that  was  pushed 
if  buttonvalue  EQ  'cancel’  then  begin 
wdget_control,  event.top,  /destroy 
return 
endif  else  $ 

widget_control,  info.tclass,  get_YaIue=str  num 


;Test  to  see  if  code  is  working 
print,  'pixel',  str_num 

if  (str_num(0)  ne  -1)  then  begin 
if(str_num(0)  eq  0)  then  class=info.numclass  $ 
dse  dass=str_nun>l 
print,  'pixel  mod',  class 
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if(info.data(info.xloc,info.yIoc)  eq  0)  then  $ 
info.confus(cIass,info.numclass)=infoxonfus(cIass,info,nuniclass)+l  $ 
elseS 

info.confijs(class,  mfo.data(info.xloc,info.yloc)-l)=  $ 
info.confus(class,  info.data(info.xloc,mfo.yloc)“l)  +1 
print,  'confiis*,  info.confus(class,  mfo.data(info.xIoc,info.yloc)-l) 
endif 

;create  new  pixel  address 

s=fix((mfo.  ns-1  )*randomu(seed))+ 1 

l=fix((mfo.nl-l)*randomu(seed))+l 

random=l*infb,ns  +  (s+l) 

print,  *new  xloc',  s 

print,  'new  yloc',  1 

print,  'random*,  random 

info.xloc==s 

info.yloc=l 

dims=[-lL, 

pos=[0] 

cuiTent=fix(envijget_data(fid=info.fid_l,  pos=pos,  dims=dims)) 
print,  'current',  current 

iab_value='image  pixel:  ('+strtrim(s,2)+'/+strtrim(l,2)  +$ 

*),  iteration  *  +strtrim(info.  count) 


test_l=where(info.r_matrix  EQ  random) 
print,  'test',  test_l(0) 

if(test_l(0)  eq  -1)  then  begin  ;test  for  prior  selection 

if(info.num  test__pix(info.data(s,l))  $ 

LT  info.strj>ix(info.data(s,l)))  then  begin 

info.r_matrix(infoxount)=random 

widget_controI,  info.lab,  set_value=lab_value 


;clear  the  text  widget 
widget^control,  info.tclass,  set_value="” 

;increment  the  counter 
info.  count=rinfoxount+ 1 
info.rjiiatrfac(info.count)=random 
endif  else  widget_control,  info.tclass,  set_value==*-l' 
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endif  dse  widget__control,  info.tclass,  set^vahie^'-r 
print,  *numtram*,  info.num^train 
print,  'count',  info.count 
if(mfo.count  GE  info.num  train)  then  begin 
wdget^control,  event.top,  /destroy 

print,  'Stratified  random  sampling  confusion  matrix' 
print, '  info.cl  names 
for  i=0,info.numcIass-l  do  begin 
print,  infbxl_namcs(i),  infbxonfiis(*,i) 
endfor 

print,  'noclass',  info.confus(*,info.numclass) 

;  Allocate  memory  array  or  open  output  file 
get Jun,  unit 

if(info.in_memofy)  then  mem_res=mtaiT(info.numcIass+l,  $ 
infoxumclass+l)  $ 
else  openw,  unit,  info.out_name 

;store  outptrt  confusion  matrix 
if(info.in_memory)  then  mem_res=info.confus  S 
else  prints  unit,  info.confus,  infoxl  nan^ 

fi'eejun,  unit 

return 

endif 

;retum  the  info  variable  to  the  top  level  base 
widget_control,  event.top,  set_uvaIue=mfo,  /no_copy 

end 


pro  st  con^doit,  fid_l=fid_l,  pos_l=pos_I,  dims_l=dims_l,  $ 
fid_2=fid__2,  dims_2=dims  2,  pos_2=pos_2,  out_name==out_name,  $ 
imm_train=num_train,  in_mcmory=in_mcmory,  $ 
r_fid_,l=r__fid_^l,  r^fid_^2-r_fid_2 

;  Access  Class  names  fi’om  original  image 

envi_file_query,  fid__2,  fiiame=fhame,  nb=nb,  ns=ns,  nl=nl,  $ 
bnames=bnames,  xstart=xstart,  ystart=ystart 
bnames_2=bnames 
print,  bnames',  bnames_2 
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teinpa=si2e(bnames) 
name_type=tempa(2) 
ronds=^vi_get_ronds(fid=fid_2) 
print,  *roiJds',roi_ids 
numclass=n_elements(roiJds) 

c!_names=mak:e_array(n_elements(ronds),  type=nanie_type) 
for  i=0,  numclass-1  do  begin 
roi_addr=envijget_roi(roi Jds(i),  roi_name=name) 

;print,  'name',  name 
cl__names(i)==name 
endfor 

print,  'class  names',  cl_names 
;  Access  Class  Image  information 

envi_file_query,  fhame=fhame,  nb=nb,  ns=ns,  nl=nl,  $ 
bnames=bnames,  xstart=xstart,  ystart=ystart 
;dn=0 

;envi_disp_query,  dn,xds=xds,  yds=yds,  fid=fid_l,  $ 

;  color=color 


;  Read  in  file  data 
;  Initialize  data  tile 

tilc_id=cnvi_init_tilc(fid_l,  pos_l,  num_tilcs=num_tilcs,  intcricavc=K)) 
print,  'num_tiles',  num  tiles 
;  Count  class  pixelsX 
data  =  intarr(ns,nl) 
for  i=0,  num_tiles“l  do  begin 
data(*,i*nl/num_tiles:(i+l)*nl/num_tiles-l)-  $ 
envi ^et_tile(tile_id,  i,  ys=ys,  ye=ye) 
endfor 

print,  'max',  max(data) 
numclass==max(data) 
tot=ns*nl 
;print,  'total',  tot 
numpix=lonarr(numclass+ 1 ) 
for  i=0,  ns-1  do  begin 
for  j=0,  nl-1  do  begin 
numpix(data(i,j))=numpk(data(ij))+l 
endfor 
endfor 
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;print,  *numpix',  numpix 
print,  *total',  totaI(numpix) 

;Calculate  stratified  number  of  pixds 
str j)ix=lonarr(numcIass+ 1 ) 
strj)bc=fix(Tium_train*numpix/tot) 
print,  *str_pix*,  str j)ix 

;*************Generate  random  coordinate  set************************** 

r_matrix=lonaiT(tot)  ;records  randomly  selected  coordinate  values 
num_test_j)ix=lonarr(numclass+l)  ;records  number  of  pixels  per  class 
confus=intarr(numclass+ 1  ,numclass+ 1 ) 

;  Generate  initial  random  coordinate  set 

xloc=fix((nS“l)*randomu(seed))+l 
print,  *ns\  ns 
print,  *nl',  nl 

ybc=fix((iil-l)*randomu(sccd))+l 
random=yloc*ns  +  (xloc+1) 
rjTiatrix(0)=random 
count=0 

;  get  the  pixel's  currently  defined  class  value 

dims=[-lL,  xloc-1,  xloc-1,  yloc-1,  yloc-1] 
pos=[0] 

current=fix(envijget_data(fid=fid_l,  pos=pos,  dims=dims)) 
print,  'current',  current 

;  Create  the  user  interface 
envi_center,xofiF,yoff 

tlb=widget_base(/coI, /frame,  xoff=xoflf,  yofi^off) 
sbascl=widgctjbasc(tlb,  /row) 

lab_value='image  pixel:  (*+strtrim  (xloc,2)+','+strtrim(>doc,2)+$ 

'),  iteration  T;  *+strtrim(current(0),2) 
labl=widgetjahel(sbasel,  value=lab_va1ue,  /align_center) 
sbase2=vridgetjbase(tlb,  title=' Available  Class  Regions'/fi^ame,  /row) 
label2=widget  list(sbase2,  value=cl  names) 
sbase3=widget  base(tlb,  /frame,  /row) 

Iabel3=widgetjabel(sbase3,  value="Enter  the  pixel's  true  class:") 
tclass=vridgetjtext(sbase3,  /editable,  uvalue='tclass') 
sbase4==widgetjbase(tlb,  /fi-ame,  /row) 

c_button=widget_button(sbase4,  value='Cancel',  uvalue^'cancel') 
okJbutton=widgetJbfutton(sbase4,  valxie='OK*,  iivalu^'ok') 
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;  Save  information  that  must  be  passed  between  the  main  procedure  and 
;  the  event  handler 

info={tclass:tclass,  fid_l:fid_l,ns:ns,nl:nl,strj)ix:strjttx,  $ 
counticount,  cl_names:cl__names,  in_memory:in_memory,  $ 
f_inatrix:f_matrb£,  nuni_test_pix:num_test  j)ix,  confus.confus,  $ 
data:data,xloc:xIoc,yloc:yloc,cuiTent;current,  lab_value:lab_value,$ 
numclassinumclass,  num_train:num_train,fid_2:fid_2,out_name:outjiame} 

widget_control,  tlb,  set_uvalue=info,  /no  copy 

;Reali2e  the  GUI  and  start  the  Xmanager  loop 
\vidget_control,  tlb,  /realize 

xmanager,  'st_conf_doit’,  tlb,  event_handler=‘st_CGnf_doit_event’ 
end 
> 

pro  st_con5  ev 

widget_control,  ev.id,  get_uvalue=uvalue 
if(uvalue  eq  ‘stratified’)  then  begin 
;Get  input  file 

envi_select,  titIe='Stratified  Random  Sampling  Class  Map',$ 

fid=fid,  dims=dims,  pos=pos,  /mask,  /roi 

fid_l=fid 

dims_l==dims 

pos_l=pos 

if(fid  eq  -1)  then  return 

envi_sdect,  title=’Stratified  Random  Sampling  Original  Image',$ 

fid=fid,  dims=dims,  pos=pos,  /mask,  /roi 

fid_2-fid 

dims_2=diins 

pos_2=pos 

if(fid  eq  -1)  then  return 
if(fid  eq  -1)  then  return 

;Widget  input  parameters 
envi_center,  xoff,yoflF 

base=widget_autoJbase(title='Stratified  Random  Sampling  Input  Parameters’) 
sb=widgctjbasc(basc,  /column,  /frame) 
sbl=\\'idget_base(sb,  /row) 

wp=widget_param(sbl,  prompt=‘Number  of  Training  Points’,  dt=2,  $ 
xs=6,  uva]ue=’num_train',  /auto) 
sbl=widgetjbase(sb,  /row) 

ofw=widget  outftn(sb,  func=’envi  out  check*,  uvalue='outf,  /auto) 
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;  Automanage  the  widget 
resuIt=auto_wid_mng(base) 
ifl[result.  accept  eq  0)  then  return 
num_tram=rcsult.num_train 

st_conf_doit,  fid_l=fid_l,  pos_l=pos_l,  diins_l==dims_l,  $ 
fid_2=fid_2,  pos_2=pos_2,  diins_2=dims_2,out_naine=result.outf.name,  $ 
in_memoiy=result.outf.in_memory,  num_train=num_train 
endif 
end 
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STRATIFIED  RANDOM  SAMPLING  CONFUSION  MATRIX  -  J.  Laurcnzano  1997 


;  This  program  is  designed  to  allow  the  user  to  input  truth  data 
;  for  each  randomly  sampled  image  pixel.  Initially,  the  program 
;  requires  that  the  user  enter  the  class  map  image,  the  original 
;  image,  and  the  desired  number  of  training  pixels.  The  program 
;  later  asks  the  user  to  select  the  three  spectral  bands  for 
;  image  ^splay.  The  program  generates  random  pixel  coordinates 
;  and  displays  a  portion  of  the  original  image  with  cross  hairs 
;  marking  the  location  of  the  pixel  in  question.  The  user  must 
;  select  the  landcover  class  to  which  the  pixel  belongs.  Printed 
;  output  in  the  IDL  window  consists  of  a  confusion  matrix  with 
;  appropriate  row  and  column  headings.  The  columns  represent  truth. 

;  Only  the  numeric  portion  of  the  confusion  matrix  is  stored  to  file. 

;  Thus  it  is  imperative  that  the  user  m^tain  thorough  records  for 
,  each  file. 

;***NOTE**  IF  -1  APPEARS  IN  THE  PIXEL  CLASS  INPUT  WINDOW  THE  USER 
;  SHOULD  HIT  OK  FOR  THE  PIXEL  SELECTION  TO  CONTINUE 

pro  st_roc_doit_event,  event 

;Get  the  variable  stored  in  the  top  level  base  user  value 
widget_control,  event.top,  get_uvaIue=info,  /no_copy 

;determine  which  action  caused  the  event 
widget^control,  event.id,  get_uvaIue=buttonvalue 

;Proceed  based  on  the  button  that  was  pushed 
if  buttonvalue  EQ  *cancer  then  begin 
widget__control,  event.top,  /destroy 
return 
endif  else  $ 

widget_control,  info.tclass,  get_value=str_num 


;Test  to  see  if  code  is  working 
print,  ’pixel’,  str_jium 

if  (str_num(0)  ne  - 1)  then  begin 
if(str_num(0)  eq  0)  then  class=info.numclass  $ 
else  class^str_num 
print,  'pixel  mod*,  class 
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print,  'target',  info.target 

print,  'data',  info.data(info.xloc,info.3doc) 

;stop 

ifl;info.data(info.xloc,info.yloc)  cq  info.targct-I)  tiicn  begin 
if(class(0)-l  eq  info.data(info.xloc,info.yloc))  then  $ 
info.roc_niat(0,0)=info.r6c_mat(0,0)+l  $ 
else  info.roc_mat(0, 1  )=info.roc_mat(0, 1  )+l 
endif  else  begin 

if(class(0)-l  eq  info.data(info.xloc,info.yloc))  then  $ 
info.roc_mat(l,  l)=info.roc_mat(l,  1)+1  $ 
else  info.roc_mat(  1 ,0)=info.roc_mat(l,0)+l 
enddse 
endif 


;create  new  pixd  address 

s=fix((info.ns-l)*randomu(seed))+l 

l=fix((info.  nl-1  )*randomu{seed))+l 

random=l*info.ns  +  (s+1) 

print,  'new  xloc',  s 

print,  'new  yloc',  1 

print,  'random',  random 

info.xloc=s 

info.yloc=l 


dims=[-lL,  s-l,s-l,I-l,i-l] 
pos=[0] 

cuiTent=fix(envi _get_data(fid=info.fid_l,  pos=pos,  dims=dims)) 
print,  'current',  currcnt+1 

lab_value='image  pixel:  ('+strtrim(s,2)+','+strtrim(l,2)  +$ 

')';,  currently  assigned  to  class  '+strtrim(current(0X2) 


test_l=where(info.r_matrix  EQ  random) 
print,  'test',  test_l(0) 

if(test_l(0)  eq  -1)  then  begin  ;test  for  prior  selection 

if(info.num_test_pix(info.data(s,l))  $ 

LT  info.str_pix(info.data(s,I)))  then  begin 

info.r_matrix(infb.count)=random 

widget_control,  info.lab,  set_value=lab_value 
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;clear  the  text  widget 
widget^control,  info  tclass,  set_value==”” 

;increment  the  counters 
info.count=info.count+l 
hifo.f_fnatrix(uifo.GOunt)=random 

info.num_test_pix(info.data(s,I))=info,num_test_pix(info.data(s,I))+l 
endif  else  \\ddget_control,  info.tclass,  set_value=*“r 
endif  else  widget  control,  info.tclass,  set_value=-r 
print,  *numtrain*,  info.num_train 
print,  *count',  info.count 
if(info.count  GE  info.num  train)  then  begin 
widget^control,  event.top,  /destroy 

rocjper==fharr(2,2) ;  Percentage  matrix 

roc_tot=total(info.roc_mat) 

rocj)ep=info.roc_mat/'roc_tot*  100 

print,  'Stratified  Random  Sampling  ROC  Matrix* 

print.  Hit',  Mss* 

print,  info.roc_mat 

print,  Talse',  'Correct* 

print,  'Alarm*,  'Rejection' 

print,  'Stratified  Random  Sampling  Percentage  Matrix' 

print,  TBt',  *Miss* 

print,  roc_per 

print.  Take*,  'Correct' 

print,  'Alarm*,  *Rejection* 

;  Allocate  memoiy  array  or  open  output  file 
get^iun,  unit 

if(info.m_menioiy)  then  mem_res=mtarr{2,2)  $ 
else  openw,  unit,  info,out_namc 

;  Store  output  roc  matrix 
if(info.in_memory)  then  mem_res=roc_per  $ 
dse  writeu,  unit,  info.foc_mat,‘pefGentage*,  roc^per 
fi’eejun,  unit 


return 

endif 

;retum  the  info  variable  to  the  top  level  base 
widget_control,  event.top,  setjuvaIue=info,  /no  copy 

end 
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pro  roc_doit,  fid_l=fid_l,  pos_l=pos_l,  dims_l=dims_l,  $ 

2,  pos  2=pos_2,  dbiis_2=dims  2,  out  iiaiiie=out  name,  $ 
num_train=num_train,  in_memory=in_memory,target=target,  $ 
r_fid_l=r_j5d_l,  r_fid_2=r_fid_2 


;  Access  Class  names  from  original  image 

envi_file_query,  fid_2,  fhame=fhame,  nb=nb,  ns=ns,  nl=nl,  $ 
bnames=bnames,  xstart=xstart,  ystart=ystart 
bnames_2=bnames 
print,  'bnames*,  bnames_2 
tempa=size(bnames) 
name_type=tempa(2) 
roi_jds=«tvi_get_roiJds(fid=fid_2) 
print  'roiJds',roiJds 
numclass=n  elements(roi  ids) 

cl_names=make_array(n_elements(roi_ids),  type=name_type) 
for  i=0,  numclass-1  do  begin 
roi_addr=envi _^et_roi(roi_ids(i),  roi_name=name) 
print,  'name',  name 
cl_names(i)=jiame 
endfor 

print,  'class  names',  cl_names 
;  Access  Class  Image  information 

envi__file__query,  fid_l,  fiiame=fhame,  nb=nb,  ns=ns,  nl=ml,  $ 
bnames=bnames,  xstart=xstart,  ystait=ystart 


;  Read  in  file  data 
;  Initialize  data  tile 

tilc_id=cnv'i_init_tilc(fid_l,  pos  1,  num_tilcs=num  tiles,  mtcrlcavc=0) 
print  *num_tiles*,  num  tiles 
;  Count  class  pixels 
data=intarr(ns,nl) 
for  i=0,  num_tiles-l  do  begin 
data(*,i*nl/num_tiles:  (i+ 1  )*nl/numtiles- 1  )=  $ 
envi _^et_tile(tile_id,  i,  ys=ys,  ye=ye) 
endfor 


B-54 


print,  ’max’,  max(data) 
numclass=max(data) 
tot=ns*nl 
;print,  total’,  tot 
numpix=lonarr(numclass+ 1 ) 
for  i=0,  ns-1  do  begin 
for  j=0,  nM  do  begin 
numpix{data(ij))=numpix(data(ij))+l 
endfor 
endfor 

print,  ’numpix’,  numpix 
print,  total’,  total(numpix) 

;Calculatc  stratified  number  of  pixels 
str_pix=lonarr(numclass+ 1 ) 
str_pLx=num_train*numpix/tot 

f'^***********(^cratermdom  coordinate  set**’'******************^ 

r_matrix=Ionarr(tot)  ;  records  randomly  selected  coordinate  values 
numjtestj>ix=lonarr(numclass+l)  ;  records  number  of  pixels  per  class 
roc_mat=intarr(2,2) ;  ROC  matrix 


;  Generate  intial  random  coordinate  set 
xIoc=fix((ns-  l)*randomu(seed)) 
print,  ’ns’,  ns 
print,  'nl',  nl 

yloc=fix((nl- 1  )*randomu(seed)) 
random=yloc*ns  +  (xloc+1) 
count=0 

;  get  the  pixel’s  currently  defined  class  value 

dims=[-lL,  xloc-1,  xloc-1,  yloc-1,  yioc-1] 
pos=[0] 

curfent=fix(envi ^et_data(fid=fid_l,  pos^pos,  dinis==dims)) 
print,  ’current’,  current+l 


;  Create  the  user  interface 
envi_center,xofF,yoflF 

tlb=widgetJ)ase(/col, /frame,  xoflNcoff,  yofifryoff) 
sbascl=widgct_basc(tlb,  /row) 

lab_value='image  pixel:  (*+strtrim  (xIoc,2)+',‘+strtrim(>doc,2)+$ 
currently  assigned  to  class  '+strtrim(current(0),2) 
!abl==widget_Iabel(sbasel,  value=lah_value,  /align_center) 
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sbase2=widget_base(tlb,  thle='AvailaHe  Class  R^ons'/frame,  /row) 
labeI2=widget_Iist(sbase2,  value=cl_names) 
sbase3=widget_bas€(tlb,  /frame,  /row) 

Iabcl3=widgct_labcl(sbasc3,  valuc="Entcr  the  pixel's  true  class:") 
tclass=v\idget_text(sbase3,  /editable,  uvalue=tclass') 
sbase4=widget_base(tlb,  /frame,  /row) 
cJbutton=widgetJbutton(shaRe4,  value='Cancer,  uvalue='cancel') 
ok_button=widget_button(sbase4,  value='OK',  uvalue='ok') 

;  Save  information  that  must  be  passed  between  the  main  procedure  and 
;  the  event  handler 

info={tclass:tclass,  fid_I;fid_l,ns:ns,nl:nl,str_pix:str_pix,  $ 
count:count,  cl_names:cl__names,  in_memory;in_memory,  $ 
f_matfix:r_matrix,  num_test_pb£;num_test_pix,  foc_mat;roc_mat,  $ 
dat8:data,xloc;xloc,yloc:yloc,cuiTent;current,lab;lab  1 ,  $ 
numclass-.numclass,  num_tram:num_train,fid_2:fid_2,out_name;out_name,  $ 
target;targk} 

widget_control,  tlb,  set_uvalue=info,  /no_copy 

;Realize  the  GUI  and  start  the  Xmanager  loop 
widgetcontrol,  tlb,  /realize 

xmanager,  'roe  doit',  tlb,  event_handler='st_roc_doit_event' 
end 

pro  st_roc,  ev 

widget  control,  ev.id,  get_uvalue=uvalue 
if(uvalue  eq  'stratroc')  then  begin 
;Get  input  file 

cnvi  scicct,  title- Stratified  Random  Sampling  Class  Map',$ 

fid=fid,  dims=dims,  pos=pos,  /mask,  /roi 

fid_l=fid 

dims_l=dims 

pos_l=pos 

if(fid  eq -1)  then  return 

envi_select,  title='Stratified  Random  Sampling  Original  Image',$ 

fid=fid,  dims=dims,  pos=pos,  /mask,  /roi 

fid_2=fid 

dims_2=dims 

pos_2=pos 

if(fid  eq  -1)  then  return 
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;Widget  input  parameters 
envi_center,  xoflF,yoff 

base=widget_auto_base(title=‘Stratified  Random  Sampling  Input  Parameters') 
sb=widgct_basc(basc,  /column,  /frame) 
sbl=widget__base(sb,  /row) 

wp=widget_j>aram(sbl,  prompt=*Number  of  Training  Points’,  dt=2,  $ 
xs=6,  uvalue=’num  train’,  /auto) 
sbl=widget__base(base,  /col) 
wp=widget  param(sbl,  $ 

prompt='Region  of  Target  Class  Representation  (1  or  2)\  $ 
uvalue=‘target’,  default=l,  /auto) 
sbl=widget__base(sb,  /row) 

ofw==widget_outfin(sb,  func=’envi_out_check*,  uvaIue='outf,  /auto) 

;  Autonianage  the  widget 
result=auto_wid_ning(base) 
if(result.accept  eq  0)  then  return 
num_train=result.num_train 
target=result.  target 

roc^doit,  fid_l=fid_l,  pos_l=pos  1,  dinis  l=dims_l,  $ 
fid  2=fid  2,  pos  2=pos  2,  dims  2=dims  2,  out  name=result.out£name,  $ 
in_memory=result.outf  in_memory,  num_train==num_train,  target=target 
endif 

end 
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